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Several  vibrator,  a<»*  jet,  and  moving-button  tactile  stimulator- 
units  were  evaluated  es  cuing  aide  for  pilot  training  in  a  annual  tracking 
task.  The  best  units,  as  determined  by  min laua  neon  square  error  and 
best  operator  describing  function  were  built  into  a  flight,  simulator. 

These  units  were  further  evaluated  for  their  ability  to  help  pilots  con¬ 
trol  the  trainer  in  some  flight -simulation  tracking  tasks  such  as  altitude 
holding  and  1L-S  landing.  A  one -dimensional  tactile  cuing  system  was  de¬ 
signed  using  information  obtained  from  these  experiments.  The  cuing  system 
which  consisted  of  two  vibrators  attached  to  the  arms  indicating  heading 
error  in  excess  of  five  degrees,  was  tested  in  a  controlled  experiment 
with  four  pilots  having  less  than  200  hours  of  flight  time.  The  two  pilots 
using  the  cuing  system  learned  significantly  faster  than  the  two  pilots 
not  using  the  system.  This  increased  learning  rate,  however,  was  only 
seen  when  the  pilots  were  engaged  in  side  tasks  such  as  problem  solving 
and  the  taking  of  clearances .  Plans  for  a  more  complete  test  of  this 
cuing  system  and  for  possible  extensions  of  the  cuing  system  to  other 
aircraft  variables  are  suggested.  A  selected  review  of  the  literature  and 
current  research  was  carried  out  to  assess  the  feasibility  and  appropriate¬ 
ness  of  b ios t inula t ion  and  bioelectric  control  for  pilot  training  and  air¬ 
craft  control. 


SUMMARY  AND  CONCLUSIONS 


PROBLEM 

Air  Force  activity  in  this  area  dates  back  to  the  early  1950’s  when  a 
tactual  sensory  control  system  *vas  studied  in  the  context  of  aircraft 
guidance.  Current  technological  advances  end  the  results  of  recent  laboratory 
investigations  at  a  number  of  universities  and  under  military-sponsored  re¬ 
search  have  suggested  that  knowledge  about  tactual  communication  has  advanced 
to  the  point  at  which  the  design  of  a  complete  tactual  cuing  system  is 
feasible  and  practical.  Sensory  modalities  other  than  vision  and  hearing 
provide  relatively  uncluttered  information  channels  for  supplementing  or 
complementing  the  more  heavily  used  receptor  channels.  At  the  present  time 
the  visual  and  aural  senses  of  the  pilot  are  employed  to  very  near,  if  not 
in  excess  of,  full  capacity.  Efforts  to  relieve  these  two  senses  and  add 
to  flying  efficiency,  as  well  as  safety,  have  been  accomplished  primarily 
within  the  same  sense  sodality.  Adding  additional  indicators  to  already 
saturated  instrument  panels  and  visual  requirements,  or  adding  additional 
override  circuits  to  the  auditory  composite,  may  be  adding  as  much  noise 
as  signal  to  the  information  flow.  The  use  of  the  uncluttered  tactual 
channel  may  afford  an  opportunity  to  improve  pilot  training  as  well  as  un¬ 
burden  the  visual  and  auditGry  channels.  The  value  of  tactual  cuing  for 
pilot  training,  flight  safety,  and  operational  performance  appears  promising 
but  it  is  relatively  an  unexplored  area. 

APPROACH 

The  major  goal  was  to  design  a  tactual  systes  and  to  establish  an  ex¬ 
perimental  design  to  assess  its  performance.  A  review  of  the  status  of 
technology  showed  that  to  produce  a  useful  design  would  require  extensive 
experimentation.  The  results  of  previous  work  in  tactual  stimulation  were 
not  in  a  flight  context  and  could  not  be  directly  applied  to  flying  without 
a  serious  over-extension  of  the  state-of-the-art.  Therefore,  an  experimental 
program  was  initiated .  The  strategy  was  to  start  with  a  number  of  promising 
possibilities,  identify  the  most  attractive  of  these  through  preliminary 
experiments,  and  then  refine  the  choices  with  more  extensive  experimenta¬ 
tion.  Tactual  research  facilities,  utilized  in  support  of  Air  Force  and 
NASA  research  requirements  over  the  past  five  years,  were  coupled  with  a 
flight  simulator,  i.e.,  a  General  Aviation  Trainer  (GAT-1). 

RESULTS 

Tactual  cues  seemed  to  be  neglected  in  favor  of  the  primary  visual 
instruments  until  the  pilot  became  overloaded.  Without  side  tasks  (free 
flight  condition)  it  made  no  difference  whether  or  not  tactual  cuing  was 
used.  With  the  most  difficult  side  task  (clearances)  the  difference  was 
maximum  Tactual  cuing  was  important  mainly  when  the  pilot  was  loaded  with 
work  that  keeps  him  busy  while  he  has  to  control  the  aircraft. 
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i  tactual  system  employed  in  this  study  was  uncomplicated 
;ive,  the  state-of-the-art  of  tactual  systems  in  the  con- 
ilning  has  not  advanced  to  the  point  where  a  design  for  a 
tern  can  be  developed  without  qualifications.  However,  if 
its  to  develop  and  test  a  tactual  cuing  system  to  take  ad- 
aming  acceleration  reported  in  this  study,  a  two-stage 
gn  is  recommended . 
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SECTION  I 


INTRODUCTION 


This  report  describes  the  results  of  a  one-year  study  on  the  potential 
effectiveness  of  haptic  (or  tactile)  cosmmication  in  the  training  of  Air 
Force  pilots.  The  purpose  of  the  research  was  to  find  ways  to  enhance  the 
undergraduate  pilot  training  prograa  by  suppleaenting  or  complementing  the 
visual  and  auditory  senses.  The  general  objectives  of  the  project  were  as 
follows : 

(1)  To  study  all  factors  relating  to  a  haptic  system  from  the 
sensory,  perceptual,  flight-control,  and  training  standpoints. 

(2)  To  identify  those  aspects  of  flight  control  and  pilot  training 
for  which  haptic  communication  is  most  appropriate,  feasible, 
and  effective. 

(3)  To  review,  evaluate,  and  describe  existing  haptic  r n—  nn i r  ■ 
tion  aids,  devices,  designs,  and  patents. 

(4)  To  design  a  complete  haptic  system  to  supplement  or  complement 
the  visual  and  auditory  senses  as  used  in  learning  how  to  fly. 

(5)  To  prepare  an  experiaental  design  that  will  assess  the  value 
of  the  haptic  system  for  training  purposes  and  specify  the 
criterion  data  to  be  collected . 

In  this  report  Section  II  deals  with  Items  1  and  2  above,  and  Section 
III  deals  with  Item  3.  While  the  major  goal  of  the  project  was  to  produce 
a  design  of  a  haptic  systen  and  an  experimental  design  to  assess  its  value, 
the  results  of  the  review  of  existing  haptic  communication  aids  clearly 
showed  that  to  produce  a  useful  design  would  require  extensive  experimenta¬ 
tion.  While  several  related  previous  projects  have  been  described  in  the 
literature,  the  results  of  these  projects  did  not  answer  most  of  the  ques¬ 
tions  involved  in  the  design  of  a  haptic  systea  for  pilot  training.  We 
therefore  embarked  on  the  experimental  program  described  in  Sections  IV, 

V,  and  VI. 

The  range  of  possibilities  for  haptic  cuing  in  pilot  training  is  large — 
much  too  large  to  be  exhaustively  tested  in  a  one-year  program  of  this  mag¬ 
nitude.  Therefore  we  were  required  to  follow  a  strategy  of  starting  with  a 
number  of  promising  possibilities,  finding  the  most  attractive  of  these 
with  preliminary  experiments,  and  then  refining  the  choices  with  more  ex¬ 
tensive  experimentation.  Throughout,  we  used  the  computer-based  facilities 
for  tactile  research  that  we  have  developed  over  the  past  five  years  under 
Air  Force  and  NASA  support  to  quickly  set  up,  run,  and  analyze  results  from 
the  various  experiments.  The  prior  existence  of  these  facilities  together 
with  the  addition  of  the  General  Aviation.  Trainer  (GAT-1)  during  the  project 
greatly  enhanced  this  research. 


SECTION  II 

SELECTION  OF  FLIGHT -TRAINING  TASKS  FOR  EAPTIC  COMMUNICATION 

1.  AIRCRAFT  FLIGHT  PROCEDURES 

A  careful  revie*  of  the  undergraduate  pilot -training  (UPT)  flight  pro¬ 
cedures  as  outlined  in  Syllabus  of  Instruction  for  Undergraduate  Pilot 
Training  (Nr.  P-V4A-A)  was  Bade  and  the  a  any  detailed  flight -training  pro¬ 
cedures  were  categorized  and  evaluated  for  the  application  of  haptic  cuing. 
The  main  categories  selected  encompass  the  UPT  curricult*,  and  these  cate¬ 
gories  are  outlined  below. 

The  operation  of  an  aircraft,  insofar  as  the  role  of  the  pilot  is 
concerned,  can  be  divided  into  the  three  general  categories:  ground  pro¬ 
cedures,  contact  flying,  and  instrument  flying.  Typical  elements  contained 
within  each  of  these  categories  are  listed  below: 

(1)  Ground  Procedures 

(a)  Flight  Planning 

•  Course  layout 

•  Weather  briefing 

•  Weight,  fuel,  performance  calculations 

•  Flight -plan  filing 

(b)  Preflight  Inspection  of  Aircraft  Exterior  and  Engine 

(c)  Cockpit  Check  of  Instruments,  Radios,  and  Auxiliary 
Systems 

(d)  Engine  Start 

(e)  Taxiing  and  Ground  Maneuvers 

(f)  Engine  Run-Up  and  Controls  Check 

(2)  Contact  Flying  Procedures 

(a)  Take-Off  Roll  and  Transition 

(b)  Landing  Flare,  Touchdown,  and  Rollout 

(c)  Ground  Reference  Maneuvers 
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(b)  Procedure  Maneuvers 

•  Climbout  and  departure 

•  Enroute  change  of  heeding*. and  altitude 

•  Holding  patterns 

•  Area  approach  and  letdown  procedures 

•  Land ing  approaches 

(c)  Navigation 

•  Position  fixing 

•  Course  following  snd  off-course 

•  Reporting 

•  A1C  traffic-control  procedures. 

2.  METHODOLOGY  USED  TO  SELECT  TASKS  FOR  HAPTIC  CUING 

The  methodology  developed  for  the  selection  of  flight -training  tasks 
suitable  for  the  application  of  haptic  cuing  is  represented  schematically 
in  Fig.  1. 

The  first  step  in  determining  whether  haptic  cuing  could  be  applied  to 
a  given  flight -train ing  procedure  or  maneuver  was  to  assess  whether  a 
suitable  sensing  and  reference  system  existed  that  could  provide  control 
information  for  the  tactual  stimulators.  No  instrumented  reference  system 
is  readily  available  for  many  of  the  functional  categories  in  the  flight¬ 
training  outline.  It  is,  of  course,  possible  to  consider  the  instructor- 
pilot  as  such  a  reference  system  and  to  permit  him  to  sense,  judge,  and 
then  to  control  the  tactual  stimulators.  This  alternative  is  considered 
separately  and  discussed  in  Sec.  I I -4. 

Visual  references  outside  the  cockpit,  in  a  traffic  pattern  for  ex¬ 
ample,  may  provide  a  quantitative  measure  of  performance,  but  this  infor¬ 
mation  is  not  readily  accessible  in  instrumented  form  for  generating  a 
reference  signal.  The  task  of  flying  inbound  on  an  ELS  localizer,  on  the 
other  hand,  admits  of  a  reference  signal  that  is  both  quantitative  and 
accessible.  Other  suitable  references  are  provided  by  autopilot  systems, 
flight  instruments,  navigation  instruments,  or  special-purpose 
instrumentation . 

Given  an  instrumented  task,  there  is  a  choice  of  presenting  the 
entire  range  of  this  variable  tactually  or  of  selecting  a  desired  per¬ 
formance  value  and  presenting  tactually  only  small  variations  (errors) 


about  this  selected  value.  The  tactual  presentation  of  the  deviation  or 
error  signal  from  a  selected  reference  value  was  the  method  chosen,  because 
of  the  wide  range  c.€  many  of  the  instrumented  parameters  (airspeed,  alti¬ 
tude,  heading,  etc.),  and  the  limited  resolution  of  tho  tactile  channel. 

The  tasks  chosen  for  testing  were  ones  in  which  the  selected  perfor¬ 
mance  reference  value  remains  a  constant — for  example,  hold  a  constant 
altitude  while  executing  a  variety  of  other  assigned  tasks,  such  as  going 
from  cruise  configuration  to  slow  flight  and  the  reverse. 

Once  the  value  of  tactual  reinforcement  is  established  using  tasks 
where  a  constant  reference  value  can  be  used,  consideration  can  be  given 
to  the  wider  class  of  aeneuvers  that  require  a  changing  reference  value. 

The  selection  of  the  tactual  display  mode  is  influenced  by  the  basic 
use  chosen  for  the  tactual  signal.  Two  uses  can  be  isolated:  First  the 
tactile  channel  may  be  used  purely  as  a  teaching  aid — that  is  to  rein¬ 
force  techniques  that  have  already  been  learned.  Second,  the’channe!  may 
be  used  purely  for  transmission  of  new  or  back-up  information.  A  combina¬ 
tion  of  these  two  techniques  may  also  be  “useful . 

The  use  of  the  first  two  display  modes  would  he  limited  to  a  rein¬ 
forcement  application.  For  example,  presenting  existence  and/or  magnitude 
of  error,  but  not  direction,  forces  the  student  to  look  at  the  appropriate 
instrument (s)  to  take  corrective  action  when  the  magnitude  of  the  error 
is  sufficiently  great  to  warrant  his  attention.  This  will  both  reinforce 
his  instrument  scan  and  thus  aid  in  enabling  him  to  learn  tc  divide  his 
attention  properly,  an  important  and  often  difficult  tasx  to  master. 

The  third  and  fourth  modes  reinforce  and  also  provide  a  primary  or 
back-up  channel  of  information.  For  example,  during  a  visual  approach 
to  landing,  the  pilot’s  attention  should  be  centered  outside  the  aircraft; 
yet,  the  airspeed  is  a  critical  parameter  that  should  be  maintained  at  s 
selected  value.  The  tactile  presentation  of  the  airspeed  variation  from 
the  selected  approach  value  could  reduce  the  number  of  times  the  pilot 
would  need  to  divert  his  attention  to  look  at  the  instrument  panel  during 
an  approach,  and  provide  him  a  continuous  indication  of  airspeed  to  enable 
a  more  precise  and  safe  approach  to  be  made. 

3.  EXPERIMENT  DESIGN 

Three  different  experiments  were  designed  for  testing  these  ideas. 

All  three  used  signals  available  on  the  instrument  panel  as  their  reference. 
From  the  selected  instrument  simulation  circuitry  an  expanded  part  of  the 
instrument  scale  is  presented  using  the  third  and  fourth  modes  described 
above.  A  short  description  of  the  experiments  is  given  below. 


a.  Altitude  Holding 


'  This  axpOrisent  covptred  several  displays  on  an  altitude-holding 
task.  In  each  test  the  pilot  attempted  to  hold  his  altitude  constant  at 
1000  feet  and  his  heading  constant  at  270°,  while  following  a  time  schedule 
requiring  him  to  change  airspeed  every  90  seconds.  On  each  tost,  a  tactile 
display  presented  the  altitude  deviation  from  1000  feat. 

b.  Altitude  Tracking 

Thi~  experiment  co»rpared  altitude  tracking  with  and  without  each 
pilot’s  favorite  display.  The  pilot’s  ta6k  was  to  hold  his  altitude  con¬ 
stant  at  1000  feet  and  his  heading  constant  at  270°  for  a  f lve-minute  run. 
A  pseudo-random  coca  and  signal  added  to  the  GAT-11 s  altitude  made  the  task 
fairly  difficult.  Both  altitude  and  heading  cuing  irere  tested. 

C.  US  Landing 


This  experiment  measured  the  pilot’s  ability  to  make  an  1LS 
landing  approach  with  and  without  tactile  cues.  The  pilot  is  instructed 
to  aalnt&in  his  a irspeed  at  85  mph  during  the  approach  and  to  stay  centered 
on  the  beam.  Tactile  cuing  tes is,  alternately  using  both  airspeed  devia¬ 
tions  and  glide-slope  deviations  were  carried  out. 

4.  THE  ROLE  OF  THE  FLIGHT  INSTRUCTOR 

Hie  role  of  the  flight  instructor  as  indicated  in  Fig.  1  is  as  a  sub¬ 
stitute  to  interpret  the  measured  performance  against  the  selected  per¬ 
formance.  This  means  the  instructor  would  read  the  selected  flight 
instrument  or  judge  the  external  visual  cues,  and  compare  with  the  desired 
performance  and  then  manually  operate  the  haptic  cuing  system.  Tills  is 
not  believed  to  be  a  desirable  function  for  the  instructor  to  perform, 
for  two  Important  reasons: 

(1)  Simple  instrumentation  can  compare  the  selected  value 
against  i he  measured  value  accurately,  reliably,  end  with 
repeatable  characteristics.  This  would  be  difficult  for 
an  instructor  to  do. 

(2)  There  are  many  other  more  important  functions  that  the 
instructor  must  perform.  Many  of  these  functions  couid 
not  be  performed  or  would  be  inadequately  accomplished 
if  his  attention  were  required  to  measure  and  compare 
performance . 

The  following  are  some  of  the  key  functions  that  the  flight  instructor 
must  perform: 
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(1) 


Instruction  In  Specific  riving  Maneuvers  sod  Techniques 
(a)  Verbal  Description^  o t  Training  Maneuvers 
(i)  Explain  pui’poss  oi  maneuver 
( ii)  Description  of  maneuver 

•  Background  and  relationship  oi  this 
sac8uver  to  previous  maneuver  and 
experience 

«  Not  aspects  of  this  maneuver 

•  Significant  points  explained  in  detail 

•*  Ael'odynssaic  and  aircraft  sot  ion 
characteristics 

••  Pilot  reference  systems  both 
instrument  and  external  visual 

M  Pilot  control  techniques. 

(b>  Plight  Deiaofl sc ratios  and  Shortened  Verbal  Description  to 
Snatch  and  Supplement  Demonstration 

(?)  Assist  the  Students'  Initial  Attempts  to  PcvrfOrft  Key 
Msssuvers 

(i)  Verbal  corrections 

til)  Physical  help  by  instructor  vith  controls 
if  needed 

?lii)  Further  explanation  cid  demonstration  in 
areas  of  student  difficulty 

(d)  Instructor  Must  Analyze  the  Student's  Performance  and 

Determine  That  is  Wrong  and  the  Causes  Behind  the  Problems 

(i)  Failure  to  understand  clearly  the  maneuver 

(ii)  Inability  to  naster  the  execution  of  the 
naneuver 

•  Weak  in  sensing  the  aircraft  state  in 
the  environment  and  hence  unable  to  de¬ 
termine  required  control  action 


•  Weak  in  performing  skills 

•  Inability  to  combine  past  experience 
and  present  skill  level  into  appro¬ 
priate  responses  to  new  or  different 
situations 

•  Poor  judgment,  poor  reasoning,  under 
pressure . 

(2)  Other  Tasks 


(a)  The  Overall  Comand  Responsibility  for  the  Safety  and 
Proper  Operation  of  Each  Training  Flight 

(b)  The  Assessment  and  Evaluation  of  a  Number  of  Characteristics 
and  Capabilities  of  the  Student- 

(i)  Overall  flying  proficiency 

(ii)  Alertness 

(iii)  Discipline 

(iv)  Judgment 

(y)  Ability  to  plan  ahead  and  anticipate 
forthcoming  situations 

(vl)  Retention  Rnd  previous  knowledge  and 
skills 

(vii)  Sense  and  apply  the  appropriate  positive 
and  negative  reinforcements  when  seeded, 
as  determined  by  the  student’s  performance 
and  personality. 

These  are  all  very  significant  functions  of  the  instructor  and  are 
applied  to  botr,  the  detailed  maneuvers  and  technique  of  flying  and  the  over¬ 
all  flying  performance  of  the  student.  Detailed  interactions  of  the  student 
and  instructor  c*ccur  that  can  be  both  beneficial  sna  detrimental  to  the 
progress  of  the  studsnt. 

It  is  not  at  ell  clear  that  tactile  reinforcement  or  communication 
would  be  usef’il  to  the  student,  or  to  the  instructor  in  performing  these 
functions.  Therefore  the  tasks  for  evaluating  tactile  reinforcement  and 
data  communication  were  selected  from  those  with  an  instrumented  reference, 
as  outlined  in  Fig.  1. 
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5.  CONCLUSION 

The  wide  diversity  of  maneuvers  involved  in  flight  training  results 
in  continually  varying  references  for  judging  student  pilot  performance 
Three  aaneuvers  related  to  instrument  flight  training  were  selected  for* 
the  haptic  cuing  tests  in  the  simulator.  While  the  results  from 

specific  experiments  were  encouraging,  the  specific  tasks  so  instrumented 
are  a  very  small  part  of  the  overall  training  curriculum.  To  implement  a 
significant  part  of  the  curriculum  would  require  a  complex  reference 
system  to  meet  the  variety  of  demands  placed  on  it.  Haptic  cuing  would 
therefore  have  a  greater  effect  on  flying  as  a  basic  information  channel 
rather  than  a  learning-reinforcement  channel.  However,  its  value  in 
either  or  both  cf  these  roles  can  be  determined  only  through  careful,  un¬ 
biased  experimentation. 
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SECTION  III 

SURVEY  OF  LITERATURE  ON  TACTILE  DISPIAYS 


A  literature  survey  was  conducted  to  find  the  most  pertinent  studies 
on  the  U3e  of  tactile  displays  in  vehicle-control  tasks.  The  results  are 
shown  in  condensed  fora  in  Table  I .  Although  only  two  of  the  references* 
discuss  direct  applications  to  the  control  of  aircraft,  the  Majority  are 
general  studies  of  tracking  behavior  with  tactile  displays  and  can  also  be 
considered  for  use  in  aircraft  control  functions. 

The  references  describe  a  wide  range  of  tactile  display  systems,  but 
unfortunately  most  investigators  used  means  of  evaluating  their  displays 
that  are  either  unrealistic  or  do  not  allow  comparisons.  For  example,  ex¬ 
periments  that  use  predictable  single-sine-wave  cos® and  signals  are  not 
realistic,  in  that  these  laboratory  tests  cannot  be  used  to  predict  real- 
world  results,  where  the  perturbing  influences  are  invariably  random  and 
unpredictable.  Also,  a  difficulty  with  most  of  the  older  work  is  that  it 
relied  only  on  mean  square  error  for  performance  measurements.  Vfhile  this 
is  a  rough  but  adequate  measure  for  comparing  performance  within  a  given 
experiment  where  command -signal  bandwidth  and  amplitude  as  well  as  vehicle 
dynamics  are  constants,  it  is  not  satisfactory  for  comparing  displays 
evaluated  in  experiments  where  these  parameters  are  all  different.  The 
recent  use  of  describing  functions  practically  ends  this  ambiguity  because 
the  gain  and  tine  delay  of  an  operator  using  a  given  display  can  be  de- 
. -.Trained  more  or  less  independently  of  these  other  variables. 

In  spite  of  these  difficulties  the  information  in  Table  I  may  be 
partially  applied  to  understanding  the  importance  of  the  main  variables 
in  the  design  of  tactile  displays  for  pilot  cuing.  The  results  regarding 
the  main  variables  (locus  of  stimulation,  stimulus  variable,  and  display 
algorithm)  are  discussed  separately  below. 

1.  Locus  of  Stimulation.  Most  of  the  previous  studies  placed 

the  tactile  display  on  the  hand.  In  particular,  ffissenberger 
and  Sheridan  (1962)  found  that  mounting  the  display  on  the 
skin  surface  that  moves  the  control  stick  provides  better 
performance  than  counting  the  display  on  the  opposite  hand. 

This  suggests  that  a  good  location  for  a  display  is  on  the 
control  stick.  Other  studies  have  obtained  fair  results 
using  the  chest  and  forehead.  In  a  controlled  experiment 
using  describing  functions,  Bliss  (1967)  showed  that  the 
sa=e  display  cn  the  forehead  and  on  the  hand  gave  equal 
performance.  In  general  this  problem  has  not  been  well 
studied  and  no  clear-cut  guidelines  have  been  established. 


* 

References  are  listed  at  the  end  of  the  report. 
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Stimulus  Variables.  A  survey  of  the  classic*!  tactile  stimulus 
variables  is  given  by  Geldard  (1961),  who  describes  the  range 
of  each  and  some  possible  applications  to  tracking.  Kost  in¬ 
vestigators  have  used  location  as  th'-  stimulus  variable.  In 
fact  this  is  the  only  way  in  which  <rwo -dimensional  tracking 
has  been  carried  out.  In  their  Vjhary  two-dimensional  dis¬ 
plays,  both  Durr  (1961)  and  Sirs’*  end  Xadushlm  (1964)  found 
some  confusions  in  interpreting  the  display  correctly.  Using 
a  much -finer-grained  two-dimensional  display,  however,  Seeley 
and  Bliss  (1966)  found  no  such  difficulty.  Another  successful 
variable  is  kinesthetic  force  as  used  in  the  displays  of  / 

Weissenberger  and  Sheridan  (1962),  and  Fenton  (1966).  Here,  / 
kinesthetic  force  is  used  as  a  variable-intensity  stimulus. 

Tests  of  the  variable-frequency  display  of  Ballard  and 
He s singer  (1954)  have  not  been  discussed  in  the  literature, 
so  its  usefulness  is  unknown  to  us.  The  most  practising 
variables  of  those  previously  used  appear  to  be  location  and 
intensity. 

3.  Display  Algorithm.  Most  displays  have  been  linear  in  that  the 
displayed  variable  is  proportional  to  the  error  signal.  The 
chief  nonlinearity  has  been  due  to  quantization  (e.g.,  only  a 
few  levels  of  error  information  are  presented) .  Earlier  dis¬ 
plays  were  binary  (quantized  into  two  levels — e.g.,  right- 
left)  with  possibly  a  separate  "on-target"  signal.  The  re¬ 
sulting  performance  fell  short  of.  that  obtained  with  ccntimnous 
displays.  This  shortcoming  is  predicted  by  the  work  of  Bund, 
Birmingham,  Tipton,  and  Garvey  (1957),  and  Bent  (1S64),  who 
compared  visual  track ing  with  and  without  various  degrees  of 
display  quantization.  Later  tactile  displays  with  continuous 
or  finely  quantized  presentation  produced  better  tracking  per¬ 
formance.  Few  experiments  with  other  nonlinear  displays  have 
been  carried  out. 

Because  so  much  of  the  previous  data  is  difficult  to  compare,  we  decided 
to  perform  some  preliminary  display  experiments  using  both  mean-square- error 
and  describing-function  asalyses.  The  first  tests  were  non  using  various 
display  algorithms  and  body  locations  using  two  variable-intensity  vibro- 
tactile  transducers.  This  enabled  some  of  the  earlier  work  using  two  stimu¬ 
lators  to  be  compared  with  later  displays.  There  are  two  main  advantages 
to  using  the  two  stimulator  displays:  (1)  the  hardware  necessary  to  run 
the  display  is  minimal  and  (2)  there  is  high  stimulus -response  compatibility. 
The  interpretation  of  the  display  is  straightforward,  in  that  a  separate 
and  unique  action  is  dictated  by  each  vibrator. 

In  addition,  a  new  ripple-tracking  air- jet  display  was  tested  using  the 
same  analysis  methods.  The. display  seemed  promising  for  flight  control  be¬ 
cause  of  the  combination  of  stimulus  variables  it  presented.  The  ripple 
displrv  was  designed  to  produce  sensations  of  changing  intensity,  position. 
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rate,  and  possible  apparent  Motion .  Experiments  were  designed  to  test  for 
the  effect  of  different  body  locations,  display  gain,  and  cycling  tines. 
These  basic  evaluation  experiments  and  tbeir  results  are  described  in  the 
next  section. 


SECTION  IV 


PRELIMINARY  DISPLAY  EVALUATION 


Several  tracking  experiments  were  run  to  determine  the  trade-off s 
between  the  many  parameters  of  tactile  displays.  Comparisons  between 
different  displays,  gains,  presentation  algorithms,  body  locations,  and 
update  rates  were  carried  out  in  a  laboratory  manual -tracking:  task  run 
by  the  LINC-6  computer  system.  A  tracking  program  (Bliss,  Hill,  and 
Wilber,  1988,  Chapter  10)  generates  the  siw -of -sinusoids  cosmand  signal, 
accepts  the  joy-stick  position  signal,  simulates  the  test  vehicle,  and 
computes  the  resulting  error  signal  for  the  display.  In  addition,  the 
program  performs  an  on-line  Fourier  and  power  analysis  of  the  error  and 
vehicle  position  signals  in  the  compensatory  tracking  task.  The  ad¬ 
vantages  of  this  system  are  its  flexibility  in  tailoring  the  task  (e.g., 
the  command  signal  or  vehicle  dynamics)  and  speed  of  obtaining  performance 
parameters  after  a  test  run . 


Two  basic  types  of  displays  were  tested  in  these  preliminary  experi¬ 
ments.  They  were  a  two-vibrator  display,  capable  of  presenting  a  con¬ 
tinuously  varying  intensity  signal,  and  a  seven-point  on  or  off  air— jet 
display,  which  was  used  to  present  a  bidirectional  signal  quantized  into 
four  levels  of  signal  strength.  In  £.11  these  evaluation  experiments  the 
test  subject  was  seated  at  a  table  and  provided  with  a  display,  and  his 
task  was  to  move  a  joy  stick  in  his  right  hand  to  keep  the  displayed 
error  nulled.  The  integrating  test  vehicle  (i.e..  E/s  dynamics)  was 
chosen  because  it  closely  approximates  severs!  of  the  control  actions  in 
an  airplane. 


The  LINC-8  program  was  used  to  evaluate  three  intensity  algorithms, 
each  using  two  vibrators  mounted  on  the  arms  of  the  test  subject.  The 
three  algorithms  were  (1)  linear — no  vibration  for  no  error,  and  vibra¬ 
tion  increasing  linearly  with  error  cn  one  vibrator  when  the  error  w»3 
positive  and  on  the  other  vibrator  when  the  error  was  negative,  (2)  dif¬ 
ferential — ecual  vibration  amplitudes  with  zero  error,  and  a  linear  un¬ 
balancing  (up  to  0  to  ICO  percent,  or  100  to  0  percent)  with  increasing 
positive  and  negative  error  signal,  and  (3)  threshold — no  vibration  within 
a  symmetrical  error  b3cd  and  maximum  vibration  when  the  error  was  outside 
of  this  band.  These  algorithms  are  illustrated  in  Fig.  2. 

A  new  air- jet  ripple-tracking  display  was  also  evaluated  using  the 
same  tracking  program.  The  jets  are  mechanical  stimulators  pulsating  at 
150  Hz  and  producing  pressure  pulses  of  about  1-psi  amplitude.  The  error 
was  presented  to  the  subject  by  a  linear  array  of  seven  jets  on  the  back 
of  the  left  index  finger  and  hand  with  the  center  jet  of  the  array  posi¬ 
tioned  over  the  first  knuckle.  The  timing  of  the  display  was  similar  to 
the  Thunderbird  automobile  tail-light  turn  signals,  but  with  inward 
sequencing  of  the  stimulators  instead  of  outward. 
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Figure  2  Three  Types  of  Tactile-Display  Algorithms 


EVALUATION  OF  TWO-VIBRATOR  DISPLAY 


a .  Equipment 

(1)  Tactile  Stimulators 


For  preliminary  experiments,  two  vibrotactile  transducers 
were  constructed  by  modifying  two  Jensen  B4K7  loudspeakers.  The  speaker 
driver  units  are  held  against  the  skin  of  the  upper  or  lower  anus  or  the 
wrist  with  an  elastic  strap  of  adjustable  tension.  The  contact  to  the 
skin  is  through  a  5/8-inch -diameter  metal  disc.  When  in  contact  with  the 
skin,  the  moying  parts  are  enclosed  and  very  little  audible  signal 
results .* 


In  addition,  a  laboratory  vibrotactile  transducer  was 
modified  to  serve  in  the  preliminary  tracking  experiments.  The  trans¬ 
ducer  consists  of  two  plastic  driven  pins  0.040  inch  in  diameter  pro¬ 
truding  through  0.080-inch  holes  in  a  metal  plate.  The  spacing  of  the 
pins  is  adjustable  down  to  0.1  inch.  The  unit  is  capable  of  stimulating 
two  points  on  the  palm,  along  a  finger,  or  on  a  single  fingertip. 

(2)  Display  Generator 

A  display  generator  was  modified  to  provide  a  variety  of 
feedback  algorithms  for  two  vibrotactile  stimulators.  The  input  signal 
is  the  error  voltage,  and  the  output  signals  from  two  power  amplifiers 
drive  two  separate  electromechanical  transducers.  A  separately  connected 
oscillator  controls  the  frequency  of  the  vibratory  stimulators.  The  cir¬ 
cuitry  of  the  display  generator  consists  of  an  analog  multiplier,  two 
voltage  comparators,  and  a  number  of  operational  amplifiers.  A  particular 
display  algorithm  is  obtained  by  plugging  a  prewired  plug  into  a  control 
socket  on  the  generator. 

The  generator  has  three  different  algorithms  available, 
each  with  four  different  display  gains.  The  three  different  algorithms 
are  shown  in  Fig.  2.  Here  the  driving  voltages  of  two  tactile  vibratory 
stimulators  are  shown  as  e  function  of  error  voltage.  The  horizontal 
scale  in  Fig.  2  is  one  volt  per  major  division.  The  zero-error  condition 
coincides  with  the  major  vertical  axis.  All  three  display  algorithms 
have  their  full-scale  deflection  (or  vibrator  full  on,  the  other  off) 
with  a  one-volt  error  signal.  These  same  three  display  algorithms  are 
available  with  1/4,  1/2,  1,  and  2  volts  full-scale  deflection. 


* 

These  transducers  are  shown  in  Fig.  17  as  they  were  used  in  a  later 
experiment. 


b.  Experiment  I — Variable  Body  Locations 
(1)  Design 

In  order  to  find  the  most  appropriate  body  areas  for 
mounting  tactile  stimulators  on  a  pilots  a  tracking  experiment  was  set 
up  using  the  display  generator  to  power  tactile  stimulators  on  a  variety 
of  different  body  areas.  The  subject :s  task  in  the  experiment  was  to 
mainta.'n  the  position  of  a  vehicle  (a  single  integrator  in  this  case) 
that  was  additively  under  the  influence  of  a  pseudo-random  command  signal 
generated  by  the  computer  and  a  joy  stick  controlled  by  the  subject. 

The  command  signal  generated  by  the  LINC-8  computer  con¬ 
sists  of  a  sum  of  ten  sinusoids  of  equa*  amplitudes  at  frequencies  shown 
in  Table  II.  The  initial  phases  of  all  frequency  components  is  zero  de¬ 
grees  and  the  length  of  the  run  is  two  minutes.  In  all  of  the  tactile 


Table  II 

COOthSD  FREQUENCIES  OF  PROGRAM  TR12/6 


Component 

Frequency 

(Hz) 

1 

0.0137 

2 

0 .0250 

3 

0.0417 

4 

0.0584 

5 

0 .0920 

6 

0.108 

7 

0.142 

8 

0.242 

9 

0.358 

10 

0.508 

tracking  runs  the  display  generator  was  programmed  to  give  the  response 
shown  in  Fig.  2(a)  with  s  modulation  of  100  Hz  and  a  1/2 -volt  full-scale 
deflection.  In  addition  to  the  tactile  experiments,  a  visual  tracking 
experiment  was  run  tc  establish  a  limit  on  the  subject’s  ability  to  track 
the  command  signal.  With  ea^h  subject  the  following  six  tracking  runs 
were  made: 

Run  1:  Visual  tracking  using  a  horizontal  line 
on  an  oscilloscope  to  represent  the 
position  of  the  vehicle.  The  scope 
vertical  sensitivity  was  0.5  volts/cs. 


I 


Hun  2 :  Tactile  tracking  using  two  separate  speaker 
transducers  counted  on  the  left  and  right 
foroaras  with  elastic  straps. 

Run  3:  Sane  as  Run  2  except  transducers  were  counted 
on  the  upper  and  lower  left  arn,  well  above 
and  below  the  elbow. 

Run  4:  Sane  as  Run  2  except  transducers  counted 
on  upper  and  lower  half  cf  left  foreara. 

Run  5:  Tactile  tracking  using  a  two-point  transducer 
counted  on  cetal  plate.  The  spacing  of  the 
vibrator  tips  was  one  inch,  so  that  the  left 
and  middle  index  fingers  could  each  contact 
a  separate  vibrator. 

Run  6:  Sane  as  Run  5  except  that  the  vibrator  tips 
were  spaced  1/4  inch  apart  so  that  they  both 
contacted  the  left  index  fingertip. 

Results 


The  subjects’  tracking  abilities  were  ceasured  in  terms  of 
the  average  error  power  over  the  two-ninute  run.  If  the  joy  stick  were 
untouched,  the  error  power  would  be  that  of  the  cosaand  signal.  If  the 
subject  interprets  the  display  often  and  correctly,  the  error  power  will 
be  less  than  that  of  the  coedod  signal.  On  the  other  hand  if  the  subject 
is  frequently  confused  by  the  display,  the  error  power  will  be  the  seae 
or  even  greater  than  that  of  the  conaand  signal .  Thus,  the  saaller  the 
error  power  the  sore  effective  the  display.  The  resulting  error  power 
normalized  to  the  cossaand  signal  power  for  the  six  tracking  runs  for 
three  subjects  is  shown  in  Table  III. 


Table  III 


ERROR  POWER  IN  UNITS  OF  COMMAND  SIGNAL  POWER 


1 

f  Rim 

i 

1 . 

Scope 

2. 

Two  Arns 

3. 

Left  Ara 

4. 

Foreara 

5. 

Two  Fingers 

6. 

Fingertip 

i  Subject  S 

JR 

EE 

JC 

Average 

0.21 

0.36 

0.23 

0.27 

0.42 

0.49 

0.84 

0.58 

0.46 

0.48 

1.23 

0.73 

0.62 

0.49 

0.87 

0.66 

0.41 

0  .48 

0.88 

0.59 

0.47 

0.37 

1.08 

0.64 

. 

Besides  visual  tracking,  on  which  subjects  did  the  best, 
the  display  locations,  in  order  ranging  from  best  to  worst  error  scores, 
are  two  ar as,  two  fingers,  one  fingertip,  the  forearm,  and  upper  and 
lower  left  arm.  The  error  scores  from  these  five  tactile  display  loca¬ 
tions  were  tested  for  significance  with  an  analysis  of  variance.  The 
results  indicated  that  the  differences  between  display  locations  are  not 
significant  [F  (4,8)  <  1).  The  difference  between  the  scope  display  and 
the  five  tactile  displays  was  similarly  tested  and  the  results 
[F  (5,10)  =  2.54,  p  <  0.10]  indicate  that  there  is  a  10  percent  proba¬ 
bility  of  getting  this  difference  by  chance  alone.  The  results  of  these 
two  tests  taken  together  show  that  differences  in  error-power  scores  are 
not  large  enough  to  draw  conclusions  about  differences  between  the  dis¬ 
play  locations,  and  we  may  assume  them  to  be  equivalent. 

As  far  as  the  subjects  a-e  concerned,  the  two  subjects 
with  previous  experience  (JH  and  KE)  die  better  than  the  subject  with  no 
previous  experience  (JC) .  This  difference  suggests  that  tactile  tracking 
proficiency  Increases  with  practice  as  does  visual  tracking  proficiency 
(McRuer  et  al.,  1965,  Fig.  28). 

To  obtain  more  information  on  the  efficiency  of  the  0.5- 
volt  linear  display,  the  combined  operator/vehicle  describing  functions 
of  tho  tactile  tracking  runs  were  computed  and  plotted  in  Fig.  3.  Sii.ce 
the  runs  are  not  significantly  different,  all  15  runs  are  averaged  to¬ 
gether  in  the  figure.  The  results  are  very  similar  to  visual  tracking 
data  obtained  by  McRuer  et  al .  (1965),  using  an  integrating  vehicle.  The 
magnitude  of  the  combined  describing  function  drops  at  about  20  dB/decade 
increase  in  frequency,  and  phase  shift  is  minus  90  degrees,  dropping  off 
with  both  the  higher  and  lower  frequencies. 

Both  the  magnitude  aDd  phase  shift  of  the  describing 
function  shown  in  Fig.  3  have  been  fitted  with  the  simple  crossover  model 
(McRuer  et  al.,  1965,  p.  151).  The  model  was  primarily  fitted  in  this 
crossover  region  (gain  ^  1.0)  of  the  curves,  and  there  agreement  is  best. 
The  curves  of  Fig.  3  indicate  the  results  predicted  by  the  model.  The 
departures  from  model  and  theory  for  frequencies  below  0.05  Hz  are  due 
to  low-frequency  operator  lags.  In  the  high-frequency  region  the  fit  is 
very  good  and  the  estimated  equivalent  gain,  K  ,  is  1.90,  and  the  esti¬ 
mated  equivalent  time  delay,  is  0,255  second.  e7he  difference  between 
visual  and  tactile  tracking  performance  will  be  discussed  in  Sec.  Ill, 
using  these  parameters . 

c .  Experiment  II — Two-Vibrator  Gain  and  Cuing -Mode  Experiment 
(1)  Design 

This  experiment  was  carried  out  to  compare  the  linear, 
differential,  and  threshold  algorithms  shown  in  Fig.  2,  using  the  tracking 
tasks  described  in  Experiment  I.  Each  of  these  algorithms  was  tested  at 


four  different  display  gains  using  three  test  subjects.  Each  subject  had 
twelve,  two-minute  tracking  rims,  one  with  each  algorithm  and  one  with 
each  gain  (0.25,  0.5,  1.0,  and  2.0  volt  for  full  display  range).  The 
twelve  runs  were  assigned  each  subject  in  a  separate,  random  order  to 
balance  cut  learning  effects  over  the  group  of  three  subjects. 

The  location  of  the  two  speaker  vibrators  (which  were 
driven  at  100  Hz)  was  always  on  the  left  and  right  forearms.  The  tracking 
program  described  in  Experiment  I  generated  the  command  signal  and  simu¬ 
lated  the  Integrating  vehicle. 

(2)  Results 

The  normalized  error  powers  from  the  experimental  test 
runs  are  shown  in  Table  TV.  In  addition,  the  error-power  scores  averaged 
over  all  three  subjects  are  plotted  in  Fig.  4.  The  general  trend  shown 


Table  IV 


AC  ERROR  POWER  DIVIDED  BY  COJSiAKD  POWER 


Full-Scale 

Display 

(volts) 

Subjects 

JH 

KE 

JC 

Average 

1/4 

0.49 

0.49 

0.54 

0.54 

Linear 

1/2 

0.64 

0.46 

0.79 

0.63 

Algorithm 

1 

0.71 

0.76 

0.97 

0.81 

2 

1.22 

1.08 

1.09 

1.13 

1/4 

0.80 

0.80 

0.94 

0.85 

Differential 

1/2 

0.91 

0.81 

0.88 

G  .87 

Algorithm 

1 

1.37 

1.25 

1.29 

1.30 

2 

4.02 

0.72 

3.97 

2.90 

1/4 

0.83 

1.12 

1.32 

1.09 

Threshold 

1/2 

0.72 

0.60 

0.92 

0.75 

Algorithm 

1 

0.77 

0.75 

1.06 

0.86 

2 

4.11 

1.00 

2.55 

2.55 

in  the  figure  is  toward  increasing  error  power  with  full-scale  display 
voltages  greater  than  0.5.  The  error-power  change  is  variable  with  smaller 
voltages  (higher  gains) .  To  determine  the  signif icant  variables  of  the 
experiment,  the  d  „■»  shewn  in  Table  IV  was  given  an  analysis  of  variance, 
the  summary  of  wfc  .  :L  s  given  in  Table  V.  The  table  shows  that  the  dif¬ 
ferent  displays  are  not  significantly  different,  even  though  the  linear- 
display  error  power  is  almost  half  the  error  power  of  the  other  two 
displays,  suggesting  that  the  linear  display  is  the  best. 


Table  V 


SU1MARY  OF  ANALYSIS  OF  VARIANCE  OF  THE  INDIVIDUAL 
ERROR-POWER  SCORES 


Source 

G* 

Kean  Square 

F  Ratio 

Significance 

Displays  (D) 

2 

1.6114 

3.13 

— 

Gsxns  (G) 

3 

4.1358 

8.04 

p  <  0.005 

D  X  G 

6 

0.5081 

<1 

Within  Subjects 

24 

0.5153 

The  analysis  of  variance  shows  that  the  effect  of  display 
gain  is  very  significant.  In  general  the  error  score  is  fairly  uniform 
in  the  0.25-to-l .O-volt  range  and  increases  sharply  at  2.0  volts.  The 
average  error  power  for  all  three  algorithms  reaches  a  minimum  at  the 
0 .5-volt  full-scale  voltage  . 

To  further  investigate  the  differences  between  the  three 
displays,  the  combined  opera tor/ integrating  vehicle  describing  functions 
obtained  using  the  three  different  displays  with  0.5-volt  full-scale  de¬ 
flection  were  calculated  and  averaged  over  the  three  different  subjects. 
These  functions  are  shown  in  Fig.  5.  Both  operator  gain  and  phase  shift 
are  plotted  at  each  of  the  ten  frequencies  of  the  command  signal.  For 
comparison  with  visual  tracking  performance,  the  visual-tracking  describing 
functions  frca  Experiment  I  are  also  included  in  Fig.  5. 

All  four  of  the  describing  functions  are  similar  as  far  as 
shape  is  concerned.  The  magnitude  of  the  describing  functions  drops  at 
about  20  dB/decade  increase  in  frequency.  The  phase  shift  is  fairly  con¬ 
stant  at  about  -90°  and  rolls  off  at  both  the  lowest  and  the  highest  fre¬ 
quencies.  These  carves  are  very  similar  to  the  one  previously  shown  in 
Fig.  4. 


The  main  diffei*ence  between  the  curves  as  far  as  magnitude 
is  concerned  is  their  varying  gain  at  any  constant  frequency.  At  fre¬ 
quencies  where  the  gain  is  about  1.0,  the  most  stable  data  points,  the 
gains  are  consistently  ordered  from  worst  to  best — threshold,  differential, 
linear,  and  visual.  (The  crossover  model  equivalent  gains  are  1.1S,  1.56, 
2.24,  and  3.30  respectively.)  This  ordering  indicates  that  of  the  three 
tactile  displays,  the  linear  display  provides  the  best  overall  operator 
gain  within  a  factor  of  two  of  the  subject’s  visual  performance.  As  far 
as  phase  shift  is  concerned,  there  is  very  little  difference  between  dis¬ 
plays.  Visual  tracking  consistently  yields  the  least  roll-off  at  higher 
frequencies  and  the  threshold  algorithm  consistently  yields  the  most,  but 
the  difference  from  best  tc  worst  is  very  small,  being  20  degrees  at  nost. 
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The  phase  variance  at  low  frequencies  is  so  large  that  no  conclusion  about 
lo» -frequency  performance  can  be  drawn. 

The  results  of  both  the  error-power  analysis  (though  not 
significant)  and  the  transfer-function  analysis  agree  as  to  the  best  and 
worst  algorithms .  The  best-to-worst  ranking,  in  both  cases,  is:  linear, 
differential,  and  threshold. 

2.  EVALUATION  OF  AIR-JET  RIPPLE -TRACK  INC-  DISPLAY 
a.  gquipaent 

Following  the  idea  that  a  tactile  display  should  change  along 
as  many  dimensions  as  possible  to  he  more  efficient  and  noticeable,  a 
tactile  ripple  display  was  devised  and  programed  on  the  LINC-8  computer. 
The  ripple  or  ''Thunder bird  tail-light"  display  produces  changes  in  overall 
intensity,  position,  and  cycle  speed  in  addition  to  allowing  possible 
apparent  motion  at  some  timing  rates. 

(1)  Hardware 

The  display  hardware  consisted  of  seven  air  jets  from  a 
computer  interface  allowing  the  simultaneous  activation  of  up  to  96  air 
jets.  Each  jet  of  air  was  formed  by  a  0.031-inch  outlet  nozzle  under 
control  of  a  high-speed  electromagnetic  valve.  The  air-pressure  pulse, 
measured  1/8  inch  directly  above  the  air-jet  outlet,  was  about  3  psi,  with 
a  rise  and  fall  time  of  about  0.5  as  and  an  overall  pulse  width  of  about 
2.0  ms.  A  160-cps  pulse  repetition  rate  was  used  throughout  the  experi¬ 
ments.  Thus,  when  the  stimulators  were  turned  on,  then  pulsated  at  the 
160-Hz  rate  until  turned  off.  The  advantages  of  air- jet  stimulation  for 
this  investigation  were  that  relatively  uniform  stimulation  was  produced 
over  nonunifona  cutaneous  surfaces  and  that  stimulator  spacing  could  be 
easily  adjusted. 

(2)  Software 

Two  types  of  displays  were  tested,  one  that  rippled  out¬ 
ward  like  the  "Thunderbird"  tail-lights,  indicating  the  direction  of  the 
error  and  another  than  rippled  inward  toward  the  center  position  indi¬ 
cating  the  direction  of  motion  necessary  to  correct  che  error.  The  timing 
of  both  of  these  displays  with  a  large  error  signal  is  shown  in  Fig.  6. 
During  timing-interval  zero,  neither  display  has  any  air  jets  activated. 
During  this  time  the  computer  measures  the  error  signal  and  decides  from 
the  magnitude  and  sign  of  the  error  signal  the  maximum  number  of  jets  to 
activate.  In  the  case  illustrated  in  Fig.  6,  the  maximum  negative  error 
signal  was  encountered  and  the  displays  both  proceed  through  three  ao  i- 
tional  steps.  The  outward  ripple  display  begins  with  two  jets  activated 
during  the  next  timing  interval  and  adds  an  additional  jet  for  each  addi¬ 
tional  timing  interval  until  the  decided  maximum  number  is  reached.  he 
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Figure  6  Hippie-Tracking  Timing  Diagram 

inward  ripple  display  begins  the  first  timing  interval  with  the  decided 
maximum  number  of  jets  activated  and  extinguishes  one  jet  at  each  succes¬ 
sive  tuning  interval  until  two  jets  are  on.  The  last  step  in  this  repeti¬ 
tive  cycle  is  the  first  in  the  next — all  Jets  are  deactivated  and  the 
error  signal  is  again  sampled . 

This  timing  sequence  is  described  by  three  time  delays  in 
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(which  turned  out  to  be  1.78  volts)  the  display  cycle  includes  the  extreme 
air  jet.  Whenever  the  voltage  is  in  the  interval  centered  around  zero 
(within  0.35  volts  of  zero)  no  air  jets  are  activated.  For  comparison 
with  other  displays,  maximum  display  indication — full  scale — occurs  at 
1.78  volts. 

(3)  Preliminary  Tests 


The  two  displays  were  evaluated  by  allowing  subjects  to 
feel  the  patterns  of  the  air-jet  display  while  the  program  was  operating 
using  a  voltage  obtained  from  a  joy  stick  under  the  subject's  control  as 
its  input.  Thus,  subjects  could  move  the  stick  and  judge  the  appropriate¬ 
ness  of  the  display.  The  three  tine  delays  T^,  Tg,  and  Tg  were  adjustable 
from  three  potentiometers  on  the  computer  panel  while  the  display  was 
running.  The  consensus  of  the  few  subjects  in  this  informal  experiment 
was  that: 

(1)  The  inward -ripple  display  was  much  better  than  the 
outward  display  because  it  showed  directly  what 
corrective  action  was  necessary  to  correct  the 
error  rather  than  just  showing  the  error. 

„  (2)  The  use  of  unequal  timing  intervals  did  not  seem  to 

bring  any  distinct  advantage. 

(3)  The  display  would  be  very  useful  in  transmitting 
information  tactually,  and  further  formal  evalua¬ 
tion  should  be  carried  out . 

b.  Experiment  III — Variable-Speed  Ripple  Tracking 


(1)  Design 

The  inward -rippling  display  of  the  exploratory  experiment 
was  incorporated  into  the  LIh'C-8  tracking  program.  The  command  signal 
had  the  same  frequency  components  as  the  previous  tracking  program,  which 
are  given  in  Table  II.  The  three  time  delays,  Tj,  T2,  and  T3,  were 
written  into  the  program  so  that  they  would  remain  accurately  known 
during  all  the  experimental  runs.  In  the  ripple-tracking  evaluation 
experiments  the  seven  air  jets  were  positioned  over  the  back  of  the  left 
hand  and  left  index  finger  as  shown  later.  The  hand  was  relaxed  and 
oriented  so  that  the  center  air  jet  was  positioned  over  the  center  of  the 
first  knuckle.  The  subject  held  the  joy  stick  in  his  right  r.and . 


* 

See  Fig. 


10(a)  . 
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Five  different  tracking  programs  were  compiled,  each  having 
a  set  of  tine  delays  differing  by  a  factor  of  two  (approximately)  from  tae 
others.  The  time  delays  used  in  each  of  the  programs  are  shown  in  Table 
VI  in  sixtieths  of  a  second.  The  minimum  update  rate  is  the  average  fre¬ 
quency  that  the  display  is  updated  when  either  extreme  air  jot  is  activated 


Table  VI 


PARAMETERS  OF  THE  RIPPLE -TRACKING  PROGRAM 


Program 

T1 

T2 

T3 

Minimum  Update  Rate 
(Hz) 

RPTK  82 

1 

1 

1 

60.0 

RPTK  62 

2 

2 

1 

34.3 

RPTK  42 

3 

3 

4 

18.5 

RPTX  22 

6 

8 

8 

9.2 

RPTX  12 

12 

12 

12 

4.6 

The  timing  of  the  two  programs,  RPTK  22  and  RPTK  42,  was  selected  to  pro¬ 
duce  approximately  100-ms  and  50-ms  timing  intervals,  which  are  appropriate 
for  producing  tactile  apparent  motion  (Kotovsky  and  Bliss,  1963;  Sherrick, 
1968) .  Tactile  apparent  motion,  having  a  direction  and  magnitude,  could 
possibly  enhance  the  effectiveness  of  the  display  by  adding  an  additional 
signal  dimension.  The  next-faster  and  next -slower  programs  RPTK  62  and 
RPTK  12  bracket  this  range  and  serve  as  controls,  while  RPTK  82  cycles 
through  the  display  timing  intervals  at  the  highest  rate  obtainable  (60  Hz) 

All  of  the  displays  had  the  same  conversion  between  error 
signal  and  maximum  air-jet  position.  Full  display  indication  occurred 
with  an  error  signal  of  1.78  volts. 

(2)  Results 

The  evaluation  experiment  consisted  of  two  test  runs  on 
each  tracking  program  by  two  of  the  same  subjects  that  participated  in 
the  previous  vibrotactile  tracking  experiments.  The  normalized  error 
power  from  each  tracking  run  is  used  as  a  measure  of  tracking  ability. 

The  smaller  the  error  payer,  the  better  the  tracking.  The  normalized 
error  powers  obtained  from  the  experiment  are  shown  in  Table  VII.  These 
data  averaged  over  the  two  test  runs  are  plotted  in  Fig.  7  for  comparison. 
The  figure  shows  that  the  error  power  decreases  nonotonically  as  the  up¬ 
date  rate  of  the  display  is  increased.  The  change  in  error  power  with 
update  rate  was  tested  with  an  analysis  of  variance  and  found  to  be  very 
significant  [F  (4,12)  =  10.15,  p<  10~**3.  The  error-power  results  are 
decreasing  even  with  the  fastest  program,  RPTX  82,  suggesting  that  even 


Table  VII 


AC  ERROR  FCSTER  DIVIDED  BY  CGi*AM>  POWER 


Prograa 

Subject 

JH 

_ 

Run  1 

Run  2 

Run  1 

Run  2 

RPTK  12 

1 .28 

1.33 

1.47 

0.96 

RPTK  22 

i  .88 

0.87 

0.91 

0.  . 

RPTK  42 

0.79 

0.68 

0.67 

0.58 

RPTX  62 

0.45 

0.50 

0.40 

0.42 

RPTK  82 

0.33 

_ 

0.38 

0.34 

0.37 

faster  cycle  rates  would  produce  better  tracking  performance .  However, 
the  curves  are  relatively  level  at  the  highest  two  update  rates  and  their 
displays  are  probably  providing  near-optisus  performance. 

The  hoped-for  improvement  with  the  lining  rates  producing 
tactile  apparent  notion  (9-  and  19-Bz  update  rates)  did  cot  materialize 
in  the  experiment.  The  apparent -sot ion  improvement  would  have  resulted 
in  U-shaped  error  curves  in  the  area  between  the  S-  and  19-3z  uptake  rates 
in  Fig.  7.  This  type  of  a  dip  is  not  apparent  in  the  figure.  Instead, 
the  rule  describing  the  results  is:  the  faster  the  cycle  tines,  the 
better  the  tracking  performance. 

To  better  understand  the  effect  of  the  var-ying  update  rates, 
the  combined  operator/vehicle  describing  functions  for  the  five  trsekieg 
programs  were  obtained.  The  results  for  the  slowest,  in  tensed  iat:?,  and 
fastest  displays  averaged  over  both  subjects  if our  runs  for  each  cur-o) 
are  shown  in  Fig.  8.  The  main  differences  shown  in  Fig,  3  ere  (2)  that 
operator  gain  increases  with  display  rate,  and  (2)  that  high-frequency 
phase  shift  decreases  with  display  rate.  The  combined  transfer  functions 
were  fitted  with  the  simple  crossover  sod el  previously  described  end  the 
results  are  shewn  in  Table  VIII.  Inspection  of  the  table  shows  that  the 
equivalent  gain,  K2,  increases  with  display  sp^ed  but  levels  off  at  about 
2.2  with  the  fastest  two  displays.  The  equivalent  time  delay,  re,  de¬ 
creases  with  display  speed  until  it  reaches  the  ususl  equivalent  operator 
time  delays  of  about  0.12  to  0.15  second  with  the  fastest  three  displays. 
The  main  difference  between  visual  tracking  and  tactile  tracking  with  the 
fastest  display  is  the  4Q -percent  gain  difference.  It  appears  that  the 
equivalent  tine  delav  say  even  be  scalier  with  the  fastest  tactile  dis¬ 
play  than  with  the  v'  rsl  display. 


Table  VIII 

SIMPLE -CROSSOVER -MODEL  PARAMETERS 


Display 

£e 

Tp  (S) 

RFTK  12 

0.69 

0.43 

RPTS  22 

0.92 

0.2S 

RFTK  42 

1.27 

0.14 

RFTK  62 

2.20 

0.1S 

!  RPTH  82 

2.25 

0.12 

1  Visual 

1 

3.30 

0.15 

c .  Experiment  TV — Variable-Gain  Ripple  Tracking 


(1)  Design 

To  investigate  the  effect  of  varying  the  gain  of  the  ripple¬ 
tracking  display,  three  additional  ripple-tracking  programs  with  different 
gains  were  compiled  using  the  sasr  oocssnd  signal  and  integrating  vehicle 
used  in  Experiment  I ,  All  three  additional  pre-rasas  used  the  fast,  60-az 
update  rate  that  was  shown  cost  efficient  in  that  experiment.  Ic  total, 
then,  four  tracking  progress  W2re  available  with  the  60 -Hz  rate:  the 
previous  program,  HPTK  82,  which  produced  &  full -scale  display  (four  jets 
actuated)  with  a  1.78-volt  error  signal,  and  the  new  prograns,  OTE610, 
R7H804,  and  KTXS02,  which  produced  full-scale  displays  with  2  0.89-, 

0 .45-,  and  0.23-volt  error  signal  respectively.  The  three  new  tracking 
progress  were  tested  using  the  same  left-hand,  left-index -finger  air-jet 
arrangement  of  the  p-evious  experiment  (Experiment  III).  One  tracking 
run  was  conducted  with  each  version  of  the  program  by  each  of  the  two 
subjects  participating  in  the  previous  experiment. 

(2)  Results 


The  normalized  error  scores  resulting  from  the  test  runs 
ere  plotted  in  Fig.  9.  Although  performance  is  fairly  uniform  for  the 
smallest  three  gains  shown  in  Fig.  9,  it  is  best  for  both  subjects  with 
the  0.89-volt  program.  Comparing  programs,  subjects  reported  that  with 
the  1.78-volt  program  the  gain  was  fairly  insensitive  snd  the  display 
would  indicate  no  error  for  periods  of  a  few  seconds  duration  during  the 
runs.  On  the  other  hand,  with  the  0.23-volt  program  the  gain  was  so  high 
that  the  display  was  only  bidirectional,  indicating  only  full  right  or 
full  left  responses  most  of  the  time.  At  the  intermediate  0.89-volt  gain, 
both  magnitude  and  direction  information  were  available. 
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d  .  Experiment  V — Vsriable-Locat  j on  Ripple  Tracking 

(1)  Design 

To  investigate  the  effect  of  presenting  the  tactile  infor¬ 
mation  of  the  ripple  display  on  different  bodily  areas  and  with  different 
spatial  arrangements,  several  tracking  tests  were  conducted.  The  same 
command  signal  and  integrating  vehicle  of  Experiment  1  were  used  with  the 
0.89-volt  full-scale  ripple  display  recocrsended  by  Experiment  IV.  The 
experiments  were  conducted  on  four  different  body  areas:  one  fingertip, 
several  fingers,  the  back  of  the  hand,  and  the  forearm.  In  addition, 
some  of  the  tests  involved  nonuniform  stimulus  spacings.  The  five 
tracking  runs  engaged  in  by  two  subjects  are  illustrated  schematically 
in  Fig.  10. 

(2)  Results 

The  normalized  error  power  obtained  from  the  tracking  runs 
is  shown  in  Table  IX.  An  entry  consisting  of  two  numbers  indicates  that 
two  tracking  runs  were  made  in  that  condition.  An  analysis  of  variance 
of  the  different-location  error  scores  shewed  then  to  be  significantly 
different  fF  (4,5)  =  19.8,  p<  0.005].  The  five-percent  t -value  for  com¬ 
paring  pairs  of  average  data  points  is  0.089.  When  this  value  is  used, 
the  performance  of  the  five  runs  can  be  ranked  from  lower  to  higher  error 


scores  as  follows : 


e  <  c  <  d . 


Table  IX 

NORMALIZED  ERROR -POWER  SCORES  IN  THE 
VAR LABLE -LOCATION  EXPERIMENT 


Location 

Subject  JH 

Subject  KE 

Average 

(a)  Back  of  hand 

0.29 

0.34 

0.315 

(b)  Palmar  side  of  fingers 

0.27,  0.42 

0.31,  0.42 

0.355 

(c)  Fingertip-expanded  scale 

0.88,  0.26 

0.60.  0.58 
- 

0.53 

(d)  Forearm-equal  spacing 

0.62 

0.64 

0.63 

(e)  Forearm-expanded  scale 

0.28 

0.34 

0.31 

The  uniformly  spaced  array  on  tne  back  of  the  hand  was 
better  than  the  uniform  array  on  the  forearm.  This  is  probably  due  to 
the  anatomical  reference  (or  zero  reference)  furnished  by  the  knuckle  of 
the  hand.  Increasing  the  spacing  of  the  stimulators  on  the  forearm  as 
shown  in  Fig.  10(e)  reduced  the  subjects'  error  power  by  about  two  to  one. 


0 


El 


37 


(*}  BACK  OF  HAND 


(b)  PALMAR  SIDE  OF  FINGEPJ 


1 


Tliis  added  spacing  serves  to  make  the  two  error  directions  more  distin- 
quishable,  as  an  anatomical  landmark  dees.  This  effect  was  also  found 
on  the  fingertip  although  formal  tests  were  not  run  with  uniform  jet 
spacing  because  the  interpretation  of  the  display  was  so  difficult.  One 
interesting  aspect  of  the  expanded  scale  displays  is  that  they  approximate 
the  two-vibrator  linear-display  described  in  Experiment  I  when  the  spacing 
is  large.  The  same  is  true  of  the  finger  display  (c)  because  under  the 
conditions  in  which  good  tracking  performance  was  obtained,  only  the  first 
jets  either  side  of  zero  came  on. 

The  main  results  of  the  experiment  are  that  similar  good 
tracking  performance  can  be  obtained  on  three  different  areas:  the  back 
of  the  hand,  the  palmar  side  of  the  fingers,  and  the  forearm.  The  de¬ 
scribing  functions  for  these  last  three  areas  were  obtained  for  both  test 
subjects.  Since  the  differences  between  these  areas  were  not  significant, 
the  test  runs  were  averaged  together  and  plotted  in  Fig.  11.  Fitting  the 
crossover  model  to  the  data  gives  an  equivalent  operator  time  delay  of 
0.16  s  and  an  equivalent  operator  gain  of  3.7. 

3.  COMPARISON  OF  TACTILE  DISPLAYS 

Considering  the  vibrator  and  air-jet  tactile  displays  tested  in  this 
section,  the  best  are:  (1)  the  linear,  differential,  and  threshold- 
intensity  algorithms  using  two  vibrators  with  full-scale  display  occurring 
at  about  50  to  100  percent  of  the  command  signsl  RMS  value,  (2)  the  air- 
jet  ripple-tracking  display  with  the  highest  ripple  rate  when  full-scale 
display  occurred  at  100  to  150  percent  of  the  command  signal  RMS  value. 

To  compare  these  tactile  displays  with  typical  visual -display  performance, 
the  equivalent  gain,  Ke,  and  equivalent  time-delay  parameters  for  the 
displays  were  computed  and  shown  in  Table  X.  Also  shown  in  the  table  are 
the  same  parameters  computed  from  data  of  Bliss  (1967)  who  used  two 
continuous-position  tactile  displays.  Because  the  other  investigators 
listed  in  Table  I  failed  to  use  describing -function  analyses,  none  of 
their  results  could  be  included  in  the  comparison. 

Since  the  displays  tested  in  this  report  used  an  integrating  vehicle 
and  those  of  Bliss  (1967)  a  position  vehicle,  the  comparison  will  be  made 
in  two  parts.  The  equivalent -gain  and  time-delay  parameters  for  the  inte¬ 
grating  vehicle  displays  have  been  plotted  in  Fig.  12.  Equivalent 
parameters  from  McRuer  et  al .  (1965,  p.  153)  obtained  from  visual  com¬ 
pensatory  tracking  runs  using  the  same  integrating  vehicle  and  several 
test  subjects  is  also  included  as  a  reference.  It  can  be  seen  In  Fig.  12 
that  the  air-jet  ripple -tracking  display  coses  closer  to  the  visual 
characteristics  than  do  the  others.  The  vibrator  displays  yield  less 
gain  and  greater  time  delays  than  the  ripple  display.  The  ripple  display 
offers  performance  fairly  comparable  to  that  obtained  with  a  standard 
visual  display.  The  gain  is  20  percent  less  but  the  equivalent  time  de¬ 
lay  is  12  percent  shorter. 
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Table  X 

EQUIVALENT  GAIN  AND  TIME-DELAY  PARAMETERS  FOR  THE 
SIMPLE  CROSSOVER  MODEL  CALCULATED  FOR  SEVERAL  DISPLAYS 


Display 

Ke 

Te 

Vibrator  Displays 

Linear 

2.24 

0.24 

Differential 

1.56 

0.20 

Threshold 

1.19 

0.28 

Ripple  Display 

3.7 

0.16 

Position  Display 

Bliss  (1967) 

Air  Jet 

3.4 

0.85 

Contact 

6.5 

0.37 

i 

These  same  two  parameters  IK  and  ^  )  are  plotted  in  Fig.  13  for  the 
visual  and  tactile  displays  using  the  position  vehicle.  Again,  the  similar 
results  of  MeRuer  (1965,  p.  93)  and  Elkind  (1956,  R-40  and  B-6  command 
signals)  are  included  as  references  using  a  visual  display  and  a  position 
vehicle.  The  results  of  Bliss  (1967)  using  a  visual  display  and  two  types 
of  tactile  displays  have  been  fitted  with  the  crossover-model  parameters 
and  these  are  also  shown  in  the  figure.  As  Bliss’  visual  and  tactile 
contact  data  was  obtained  from  one  subject,  some  care  must  be  exercised 
in  interpreting  it.  As  the  subject  was  quite  good,  his  visual  gain  being 
much  higher  than  HcRuer  and  Elkind ’s  average  data,  the  gains  on  both  his 
tactile  and  visual  runs  should  be  scaled  down  by  about  30  percent  to  matcn 
that  of  the  average  subject.  If  this  were  done  the  subject’s  gain  would 
be  about  four,  and  quite  comparable  to  that  obtained  with  the  ripple  dis¬ 
play  using  the  integrating  vehicle.  The  other  display  represented  in  Fig. 
13  is  the  continuously  movable  air-jet  display.  This  point,  representing 
the  average  of  three  subjects'  scores,  shows  that  fair  gain  but  very  large 
tine  delays  were  obtained  with  this  display. 


Comparing  all  of  the  displays  in  Figs.  12  and  13  shows  t;  at  the 
ripple  and  cont inuous -contact  displays  are  the  best,  and  vibrator  dis¬ 
plays  intermediate.  The  moving-jet  display  should  not  be  used  in  pilot 
cuing  because  of  the  inordinately  long  time  delay  associated  with  it. 

As  far  as  usable  body  areas  are  concerned,  (1)  the  vibrator  displaj  was 
equally  effective  on  all  areas  tested,  (2)  the  ripple  display  was  most 
effective  on  only  three  areas  and,  (3)  the  cont inuous -contact  display  of 
Bliss  (1967).  though  effective,  was  tested  only  on  one  area,  the  palmar 
surface  of  the  hand.  For  tactile  displays  for  pilot  cuing,  we  reccpoend 
both  the  vibrator  and  ripple  displays  ever  the  other. 
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SECTION  V 


DISPLAY-EVALUATION  EXPERIMENTS  IN  A  GAT-1  TRAINER 


1 .  INTRODUCTION 

As  a  result  of  the  work  described  in  Sec.  II,  three  experiments  were 
designed  using  reference  signals  available  from  a  GAT-1  trainer.  The 
first  experiment  described  in  this  section  compares  five  tactile  displays 
chosen  on  the  basis  of  the  preliminary  experiments  discussed  in  the  pre¬ 
vious  section,  in  an  altitude-bolding  task.  The  second  experiment  com¬ 
pares  performance  with  and  without  tactile  cuing  in  an  altitude-tracking 
task,  and  the  third  compares  ILS  landing  approaches  with  and  without 
tactile  cuing. 

An  experimental  design  including  all  three  experiments  was  constructed 
that  provided  the  following  properties: 

(1)  Compares  flight  performance  with  and  without  cuing  on  all  three 
of  the  experiments 

(2)  Compares  tactile  cuing  in  two  air-turbulence  conditions  (rough 
and  smooth  air) 

(3)  Was  balanced  against  learning  effects. 

The  results  of  the  design  are  present  2d  experiaent-by-experiment  in  the 
following  sections.  In  all  of  the  experiments,  subject’s  error-power 
scores  were  obtained  after  the  test  runs  and  used  to  compare  the  resulting 
changes  in  performance.  In  addition,  a  plot  of  the  instantaneous  flight 
variables  important  to  the  experiment  was  made  on  an  X-Y  recorder  so  that 
the  state  of  the  individual  pilot  could  be  monitored  during  the  run.  These 
plots  were  valuable  not  only  for  understanding  the  results  but  for  ex¬ 
plaining  to  the  pilots  what  was  being  monitored  and  how  they  were  im¬ 
proving.  In  addition,  pilot  describing  functions  were  used  to  compare 
performance  during  the  tracking  tests. 

2.  ADDITIONS  TO  THE  GAT-1  TRAINER 

* 

The  GAT-1  trainer  was  used  in  all  of  the  flight -simulation  experi¬ 
ments  described  in  this  report.  A  patch  panel  (shown  in  Fig.  14)  was 
added  to  the  side  of  t.*e  trainer  for  making  connections  between  the  tac¬ 
tile  displays  inside  and  the  display-driving  equipment  outside.  The  patch 
panel  also  allowed  connections  between  the  LINC-8  computer  and  electrical 
test  points  within  the  GAT-1. 


The  GAT-1  is  a  fully  instrumented  ground -base  trainer  manufactured  by 
General  Precision,  Inc.  It  is  designed  to  have  handling  characteristics 
similar  tc  those  of  the  Cessna  150. 
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Figure  14  GAT-1  Trainer  with  Patch  Panel  for  Connection*  to  tho  Computer. 

From  loft  to  right  are  tho  plotting  table,  display  generator  rack, 
oxperlmont-controlllng  teletype  with  operator,  and  GAT-1. 


Fcr  monitoring  and  injecting  signals  to  the  GAT-1,  two  interface 
circuits  were  designed.  One  circuit  for  altitude  and  heading  experi¬ 
ments  monitored  noth  true  altitude  and  heading,  and  allowed  a  command 
signal  from  the  LINC-S  computer  tc  be  realistically  added  to  the  GAT-l’s 
internal  altitude.  Another  interface  circuit  allowed  the  computer  to 
monitor  both  glide  slope  and  airspeed  while  making  an  ILS  approach. 

The  detailed  circuit  drawings  for  these  two  interfaces  are  given  in 
Append ix  A . 

In  order  to  attach  displays  to  the  control  yoke,  a  mocked-up  yoke 
was  made,  preserving  the  dimensions  of  the  original.  This  wooden  yoke 
is  shewn  in  Fig.  15  as  it  was  used  in  the  experiments.  In  total,  three 
different  displays  were  mounted  on  it  in  different  parts  of  the  experiment. 

3.  TACTILE  DISPLAYS 

Five  tactile  displays  were  chosen  for  use  in  the  flight-simulation 
experiments  conducted  in  the  GAT-1  trainer.  These  included  the  air-jet 
ripple-tracking  display  and  two  of  the  vibrator  displays  evaluated  on 
manual  control  tasks  in  Sec.  IV.  In  addition,  two  button  displays 
mounted  in  the  control  stick  were  used  that  were  not  given  previous 
testing.  The  five  displays  are  described  below: 

(i>  Air-Jet  Ripple  Display.  This  display,  described  in  Sec.  IV, 
cycles  at  the  high  SO-Hz  rate.  Figure  16  shows  the  jets 
mounted  on  the  control  yoke  of  the  GAT-1.  The  air-jet  valvea-X' 
are  controlled  directly  by  the  L  INC-8  monitor  program. 

(2)  Two-Vibrator  Threshold  Cuing  Display.  The  two  vibrators  for 
this  display  have  been  described  in  Sec.  IV  and  are  shown  in 
Pig.  17  as  used  for  altitude  cuing.  When  used  to  convey 
heading  information,  the  vibrators  are  placed  on  the  left  and 
right  upper  arms.  When  the  error  level  is  acceptable,  neither 
vibrator  is  on;  when  too  large  in  a  given  direction,  one  of 
the  vibrators  coaes  on  at  full  strength. 

(3)  Two-Vibrator  Linear  Display.  The  vibrators  are  mounted  the 
same  as  for  cuing  above;  however,  tt.a  presentation  algorithm 
is  linear  as  shown  in  Fig.  2(a).  With  larger  errors,  the 
vibration  strength  of  the  appropriate  vibrator  becomes  larger. 

(4)  Pa la -But ton  Display.  A  two-ended  plunger  moves  through  the 
body  of  the  left  control  handle  as  illustrated  in  Fig.  18. 

With  zero  error  the  button  is  in  the  neutral  position  flush 
with  both  front-  and  back-handle  surfaces.  With  either  posi¬ 
tive  or  negative  error,  the  plunger  is  driven  by*a  servo  motor 
a  proportional  distance  out  of  the  handle.  For  altitude  con¬ 
trol,  the  plunger  motion  was  front-to-back  and  for  heading 
control  it  was  rotated  90e  so  that  motion  was  left-to-right. 
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Figure  15  Interior  of  GAT-1  Cockpit  Showing  the  Mocked-up  Yoko  with  a  Tactile 
Display  on  Each  Handle  (for  Illustrative  purposes  only).  Note  the 
position  servomotor  usod  to  drlvo  button  displays  in  lower  left-hand 
corner  of  picture. 


Flgura  18  Air-Jot  Rlppla-Tracklng  Oitplty  Mounted  on  Handle  of  Mock-up 
Control  Yokt.  The  t«v«n  jin  on  an  adjustable  met*'  strap  are 
drlvan  by  alactromachanlMl  'valve*  under  the  yoka. 


(5)  Thumb-Button  Display,  This  display,  shown  in  Fig.  19,  is 

similar  to  the  palm-button  display  above.  Here,  two  buttons 
move  alternately  in  and  out  of  the  top  of  the  handle.  With 
zero  error  the  buttons  are  both  flush,  and  with  positive  or 
negative  error  one  button  or  the  other  is  driven  up  out  of 
the  handle.  For  altitude  control  the  buttons  were  aligned 
from  front-to-back,  while  for  heading  control  they  were 
lef t-to-right . 

4.  EXPERIMENT  CAH --BOLDING  CONSTANT  ALTITUDE  AND  HEADING 
a.  Design 

The  five  different  tactile  displays  were  compared  on  a  task  re¬ 
quiring  pilots  to  hold  a  constant  altitude  (1000  ft)  and  heading  (2703) 
while  alternately  changing  their  airspeed  between  two  limits  (80  and  110 
mph)  every  90  seconds.  During  each  five-minute  experimental  run  the 
pilots'  altitude  and  heading  deviations  from  the  required  constant  values 
were  sampled  by  the  computer.  After  each  run  the  computer  printed  out 
the  error  powers  of  each  deviation  on  the  control  teletype.  The  condi¬ 
tions  under  which  the  experiment  are  carried  out  are  more  completely  de¬ 
scribed  in  Appendix  B. 

Three  private  pilots  with  different  amounts  of  training  were 
selected  for  the  experiment.  The  three,  who  had  not  yet  qualified  for 
their  instrument  license,  were  graduate  students  at  Stanford  University 
and  were  paid  hourly  for  their  time  in  the  experiment.  Their  initials 
and  flight  hours  as  of  the  beginning  of  the  experiment  are  listed  below: 

Pilot  BD — 70  hours 
Pilot  CR — 150  hours 
Pilot  TH — 430  hours. 

To  test  each  display,  four  five-minute  test  runs  were  conducted 
Two  runs  were  made  using  one  tactile  display  in  addition  to  the  standard 
instruments,  and  two  runs  were  made  using  the  instruments  only.  Each  of 
these  pairs  of  tests  was  further  subdivided  into  a  run  with  maximum  rough 
air  as  simulated  by  the  GAT-1  electronic  system,  and  a  run  with  po  rough 
air  (smooth  air).  The  four  test  runs  were  always  consecutive,  with  both 
the  first  and  last  run  of  the  series  being  the  control  (or  no  display) 
condition.  Either  the  first  two  or  last  two  runs  of  the  series  (selected 
at  random)  included  the  rough-air  condition.  Thus,  the  four-test  series 
was  balsnced  to  reduce  the  practice  effect  on  the  experimental  results. 
The  two  main  experiments  'ariables  are  display  type,  and  amount  cf  tur¬ 
bulence.  The  measure  of  performance  is  the  change  in  error  power  between 
the  similar-display  and  no-display  condition. 


b .  Results  iron  Altituat*  Cuing 

The  altitude  and  heading  error-power  scores  from  the  matched 
pair*  of  runs  with  and  without  the  tactile  display  were  converted  to 
logarithmic  units  for  comparison.  The  logarithmic  scale  is  the  only  one 
that  given  equal  sad  opposite  scores  to  on  increase  and  decrease  in  error 
power  by  any  given  factor.  When  base  ten  logarithms  are  used,  logarithmic 
error-power  changes  of  plus  one  and  minus  one,  respectively,  indicate 
error-power  increases  and  decreases  by  a  factor  of  10.  The  resulting 
error-power  changes  measured  by  subtracting  the  log  error  power  without 
display  from  the  log  error  power  with  display  are  shown  in  Table  XI. 
negative  entries  in  the  table  mean  that  the  use  of  the  display  resulted 
in  reduced  error  power,  and  positive  entries  mean  that  its  use  resulted 
in  increased  error  power . 


Table  XI 

AC  ERROR-POWER  CHANGES,  IN  LOG  UNITS,  FOR  THE  FIVE  DISPLAYS  TESTED 


Air-Jet  Ripple 


Cuing  Vibrator 


Linear  Vibrator 


Thumo  Button 


Palm  Button 


Average  Change 


Altitude  i 

Head ing  I 

Smooth  Air 

Rough  Air 

Smooth  Air 

Rough  Air 

-0 .23 

-0.08 

+0.22 

-0.03 

-0.31 

+0.06 

-0.45 

-0.14 

-1.00 

+0.05 

-0.34 

+G.41 

-0.28 

+0.23 

-0.04 

-0.29 

-0.10 

-0.19 

-0.19 

-0.21 

+0.54 

+0.06 

+0.45 

-0.25 

-0.17 

+0.01 

-0.05 

0.00 

-0.15 

+0.38 

-0.06 

+0.23 

+0.02 

-0.15 

+0.14 

-0.09 

-0.33 

-0.14 

+0.07 

-0.01 

+0.15 

-0.02 

-0.09 

+0.09 

+0.15 

-0.31 

-0.157* 

1  1 

+0.008 

mm 

-0.069 

|  -1.722 

+0.100 

j  +0.447 

-0  .771 

Significant  at  the  5  percent  level. 


The  average  changes  produced  by  the  additional  tactile  display 
have  been  calculated  and  are  shown  at  the  bottom  of  Table  XI  along  with 
the  one-sided  t-test  for  differences  from  zero.  In  only  one  case  was 


mm*. 
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there  a  significant  reduction  in  error  power.  This  was  in  the  altitude 
error  power  in  the  absence  of  rough  air.  Here,  the  decrease  of  0.157 
log  unit  represents  a  3C—  percent  decrease  in  altitude  error  poser. 

Since  the  sane  change  in  the  rough-air  condition  is  very  small,  we  must 
assume  that  the  smooth-air  condition  Is  more  favorable  to  the  tactile 
displays.  When  asked  about  the  difference  between  the  rough-  and  smooth- 
air  conditions  when  using  the  tactile  displays,  the  pilots  generally 
commented  that  they  paid  more  attention  to  the  tactile  displaya  in  the 
smooth-air  condition. 

The  same  error-power  changes "we^e-jkyeraged  over  air-turbulence 
conditions  to  find  the  error-power  changes  produced  by  the  five  displays. 
Hie  average  error-power  changes  for  each  tactile  display  are  shown  in 
Table  XII  and  were  tested  for  sigr.if icance  using  t-tests.  Only  one  dis¬ 
play,  the  air-jet  ripple-tracking  display  produced  a  significant  change. 
Here  the  change  was  a  decrease  in  error  power  of  0.285  log  unit  or  48 
percent . 


Table  XII 

ERROR-POWER  CHANGES,  IN  LOG  UNITS 
AVERAGED  OVER  PILOTS  AND  ROUGH -AIR  CONDITION 


Display 

Altitude  Change 

Heading  Change 

Air- Jet  Ripple 

-0.258* 

-0.055 

Cuing  Vibrator 

-0.086 

-0.181 

Linear  Vibrator 

+0.110 

+O.03S 

Thumb  Button 

-0.047 

+0.018 

Palm  Button 

+0*015 

_ _ _ 

+0.061 

* 

Significant  at  the  2.5-percent  level. 


Since  this  particular  experiment  was  net  very  sensitive  in  de¬ 
termining  differences  with  and  without  the  tactile  cuing  devices,  a  simple 
questionnaire  was  prepared  asking  the  pilots  to  rank  the  five  displays 
from  best,  to  worst  and  to  give  a  consent  on  each  display.  Surprisingly, 
the  pilots  found  the  choice  easy  to  nake  (i.e.,  there  were  large  subjective 
differences  between  the  best  and  worst  devices)  and  indicated  with  their 
cciesents  that  they  were  very  positive  that  their  favorite  displays  were 
helpful  to  them  and  that  some  displays  were  very  burdensome  or  confusing. 

While  it  was  originally  intended  to'  average  the  rankings  and 
tost  then  statistically,  this  approach  was  abandoned.  It  turned  out  that 
while  most  pilots  thought  the  air  Jets  were  intermediate  in  value,  two 
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enthusiastically  rated  the  vibrators  attached  to  the  body  as  best;  while 
one,  with  equal  enthusiasm,  rated  the  thumb  buttons  best.  Since  the 
pilots  spent  considerable  time  preparing  their  contents  and  since  their 
opinions  are  considered  valuable,  the  three  questionnaires  are  presented 
in  unabridged  form  in  Append ic  C. 

The  pilot  questionnaires  show  a  range  of  individual  preferences 
in  tactile  displays.  While  two  pilots  preferred  to  be  warned  by  the 
automatic  body  vibrators  when  they  were  in  error  (interestingly,  the 
pilots  with  less  flight  time)  rnd  preferred  not  to  use  the  stick -mounted 
display  requiring  their  effort,  one  pilot  (with  the  greatest  flight  time) 
subscribed  emphatically  to  the  opposite  view.  In  the  design  of  a  pilot 
cuing  system  these  individual  differences  may  have  to  be  taken  into 
consideration . 


In  order  to  determine  whether  change  in  performance  using  the 
displays,  was  correlated  with  pilot  experience,  the  average  change  in 
error  power  over  all  runs  of  each  pilot  was  computed.  In  order  of  in¬ 
creasing  experience,  pilots  BD,  CR,  and  TH  showed  changes  of  -21,  -25, 
and  +7  percent,  respectively,  indicating  that  the  pilots  with  the  least 
experience  improved  store  than  the  pilot  with  the  most  experience. 

c.  Results  from  Heading  Cuing 


\ 


To  find  the  effect  of  cuing  on  a  secondary  or  more  slowly 
varying  task,  each  pilot's  favorite  display  was  used  to  give  heading 
deviations  from  the  required  course.  The  resulting  error-power  changes 
are  shown  in  Table  XIII.  The  average  results  for  each  combined  air- 
turbulence  and  coordinate  condition  were  calculated  end  are  shown  in  the 


Table  XIII 

ERROR-POWER  CHANGES,  IN  LOG  UNITS,  FOR  THE  HEADING  CUING  CASES 


[  Altitude  | 

Heading 

Pilot 

Display 

Smooth  Air 

Rough  Air 

Smooth  Air 

Rough  Air 

TH 

Thumb  Button 

+0.23 

-0.30 

-0.50 

+0.19 

BD 

Cuing  Vibrator 

+0.34 

+0.23 

-0.27 

-1.22 

CR 

Cuing  Vibrator 

-0.22 

-0.13 

-0.10 

-0.24 

Pilot  Average 

+0.119 

i 

-0.068 

-0.293 

-0.422 

Coordinate  Average 

+0.025 

-0 .358* 

Significant  at  the  5-percent  level 


table.  These  averages  were  tested  with  t-tests  and  it  wa>  found  that  only 
the  heading  error  power  changed  significantly.  The  change  of  -0.358  log 
unit  represents  an  average  error-power  drop  of  56  percent.  Comparing 
these  heading  cuing  results  with  the  previous  altitude  cuing  resulta  indi¬ 
cates  that  cuing  on  a  given  flight  variable  reduces  the  error  in  that 
variable  only. 

The  pilot  most  influenced  by  the  cuing  system  was  the  one  with 
the  least  experience,  fie  was  also  the  one  with  the  consistently  largest 
error  scores  and  thus  the  one  with  the  most  room  for  improvement .  To 
further  illustrate  the  changes  brought  about  by  cuing,  the  plot  of  pilot 
BD’s  flight  deviations  for  the  heading  cuing  experiment  is  shown  in  Fig. 

20.  The  figure  shows  instantaneous  altitude  and  heading  deviations  for 
four  consecutive  five-minute  test  nms.  Sun  3  illustrates  the  typical 
deviations  of  this  subject  over  the  five-sinute  run  without  cuing — fair 
control  over  altitude  and  poor  control  over  heading.  With  the  addition 
of  heading  cuing  in  the  next  run  (Eun  4),  better  heading  deviations  but 
worse  altitude  deviations  were  obtained.  In  Run  5  both  deviations  improve 
even  with  the  additional  influence  of  rough  air,  and  in  Run  6,  even  after 
cuing  had  ceased,  altitude  deviations  were  reduced  to  those  cf  Run  3  but 
heading  deviations  were  mere  than  halved.  Interestingly,  this  subject 
did  not  immediately  revert  to  his  pre-cuing  deviations  when  cuing  was 
removed  but  continued  better  performance  for  awhile.  The  next  test 
sessions  several  days  later  showed  that  he  had  reverted  to  his  original 
performance  pattern  (shown  in  Run  3)  of  neglecting  heading  information. 

The  fact  that  the  subject  had  learned  something  temporarily  and  retained 
it  even  after  direct  reinforcement  was  removed  indicates  that  this  cuing 
method  shows  promise  in  teaching.  One  other  pilot  (CR)  with  intermediate 
experience  reacted  to  the  cuing  similarly,  but  to  a  lesser  degree. 
Apparently  pilots  with  less  experience  learn  more  or  change  their  instru¬ 
ment  scans  and  priorities  more  than  pilots  with  more  experience. 

5 .  EXPERIMENT  AT-  -ALTITUDE  TRACKING 

a.  Design 

This  experiment  is  very  similar  to  the  previous  experiment  in 
that  the  same  subjects  participated  in  it  and  the  same  air-turbulence 
conditions  were  used.  Tests  were  of  the  same  five-minute  duration  balanced 
for  turbulence  and  learning  changes.  The  display  used  by  each  pilot  was 
the  one  that  he  preferred,  as  previously  discussed.  The  task  in  this  ex¬ 
periment  was  the  same  as  in  Experiment  CAR  (to  hold  constant  altitude  at 
1000  feet  and  constant  heading  at  270°)  except  that  a  sum-of -sinusoids 
coimaand  signal  was  added  to  the  GAT-1  altimeter  both  to  make  the  task 
fairly  difficult  ana  to  measure  pilot  describing  functions  with  and  with¬ 
out  tactile  cuing  in  addition  to  the  usual  aircraft  instruments.  The 
spectrum  of  the  comand  signal  is  given  in  Table  XIV.  The  signal  was 
tailored  to  have  low-frequency  components  approximating  rough-air  tur¬ 
bulence  within  the  controlling  ability  of  the  GAT-1  trainer — i.e.,  the 


Asplitude 

Frequency  (Hz) 

6 

0.0042 

6 

0.0083 

6 

0.0125 

C 

«/ 

0.021 

5 

0.029 

4 

0.050 

2 

0.075 

1 

JL 

0.100 

1 

0.129 

1 

0.196 

rate  of  climb  and  descent  W8S  never  so  large  that  the  airplane  could  not 
mechanically  track  it.  The  Baxinun  altitude  deviation  fro*  1000  feet 
during  the  entire  run  wss  about  350  feet.  More  details  of  the  experiment 
are  given  in  Appendix  B. 

b.  Results 

The  altitude  and  heading-error  scores  with  the  tactile  displays 
were  converted  to  logarithmic  units  and  subtracted  fro*  the  similar  air- 
turbulence  control  condition,  as  done  in  the  previous  experiment.  These 
data  are  presented  in  Table  XV  for  comparison.  Again,  negative  scores 
indicate  the  reduction  in  error  power  using  the  tactile  display,  while 
positive  scores  indicate  an  increase.  As  none  of  the  averages  in  Table 
XV  were  large  enough  to  be  significant,  there  is  insufficient  information 
to  show  that  either  altitude  cuing,  heading  cuing,  or  air-turbulence 
condition  affected  the  results.  This  is  somewhat  in  accord  with  the  re¬ 
sults  of  the  previous  experiment,  where  it  was  noted  that  the  tactile 
displays  caused  a  significant  error  reduction  with  the  smooth-air  condi¬ 
tion  but  not  with  rough  air.  Taken  together  with  the  negative  results 
of  this  experiment,  which  required  much  store  pilot  activity  to  control 
the  simulator  than  in  the  noderate  "rough-air”  condition  of  the  previous 
experiment,  the  results  of  the  two  experiments  show  that  the  effective¬ 
ness  of  the  tactile  displays  may  be  inversely  related  to  pilot  activity. 
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bean.  He  thee  started  his  approach  and  the  fi?e-minute  monitoring  program 
was  turned  on.  He  proceeded  down  the  beam  for  five  minutes  while  the 
error  power  in  both  his  glide-slope  deviations  from  zero,  and  airspeed 
deviations  ?rom  85  mph,  were  accumulated  by  the  computer.  Ibis  five- 
minute  run  took  the  pilot  approximately  to  the  middle  marker  at  an  alti¬ 
tude  of  300  feet.  At  this  point  the  pilot  was  instructed  to  climb  back 
to  200o  feet  aDd  get  ready  for  the  next  run. 


In  addition  to  the  airspeed  indicator  a  simple  cuing  display 
with  vibrators  on  the  upper  and  lower  left  atm  was  used  when  required  by 
the  experimental  design.  Both  vibrators  were  off  when  the  airspeed  was 
within  5  mph  of  85  mph,  but  the  upper-arm  vibrator  came  full  on  when  the 
airspeed  was  5  mpu  iou  slu-  and  the  lower-arm  vibrator  cane  full  on  when 
5  mph  too  fast.  These  two  locations  were  chosen  by  the  pilots  themselves 
to  be  the  clearest  to  interpret .  Other  details  of  this  experiment  are 
given  in  Appendix  B. 


b .  Results 


As  with  the  previous  two  experiments  the  error  power  in  the  de¬ 
viations  of  airspeed  from  85  mph  and  in  the  glide  slope  from  zero  were 
converted  to  logarithmic  units.  Then  the  control  (none -ling)  test  error 
scores  were  subtracted  from  the  matching  cuing  test  error  scores  to  de¬ 
termine  the  logarithm  of  the  change.  These  power  changes  for  both  tur¬ 
bulence  conditions  and  both  instruments  monitored  sure  given  in  Table  XVI. 


Table  XVI 


ERROR-POWER  CHANGES,  IN  LOG  UNITS,  FOR  TACTILE  CUING 
DURING  ILS  LANDING  APPROACHES 


Airspeed 

Glide 

Slope 

Pilot 

Saoqtb  Air 

Rough  Air 

Smooth  Air 

Rough  Air 

BD 

mmm 

-0.201 

0.087 

0.356 

BD 

-0.242 

-0.019 

0.085 

TE 

-0.078 

-0.157 

-0.330 

0.277 

TH 

-0.256 

0.159 

-0.018 

0 .087 

CR 

-0.073 

0.083 

-0.531 

-0.182 

Pilot  Average 

-0.052 

-0.072 

-0.162 

0.125 

Coordinate  Average 

-0.052 

-0.019 
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Pilots  BD  and  TH  completed  the  four  test  series  twice,  while  CR  only 
completed  it  once.  The  changes  in  error  power  shown  in  Table  XVI  appear 
to  be  spontaneous  and  variable.  Thero  is  no  column  that  is  composed 
entirely  of  numbers  of  the  same  sign.  Indeed,  when  the  pilot  and  co¬ 
ordinate  averages  were  tested  for  significance  with  t-tests,  none  of  the 
averages  were  significantly  different  from  zero.  We  must  assume  that 
the  changes  in  performance  brought  about  by  the  tactile  cues  were  small 
or  irregular. 


The  pilots  evidently  could  adequately  scan  the  airspeed  and  ILS 
instruments  and  did  not  use  the  tactile  cues  in  controlling  the  aircraft. 
In  order  to  test  this  interpretation,  pilot  BD,  on  his  second  day  cf  ILS 
approaches  (eight  having  been  completed,  four  with  tactile  cuing)  was 
given  a  four-test  series  in  which  the  airspeed  instrument  was  covered 
up  when  the  tactile  airspeed  cues  were  used .  In  smooth-  and  rough-air 
conditions  his  airspeed  error-power  scores  with  tactile  cuing  only 
ware,  respectively,  14.3  and  1.98  times  larger  than  his  control  scores 
with  the  visual  instruments  only!  The  large  (14.3)  error  score  occurred 
on  the  first  tactile-only  run  and  resulted  from  misinterpreting  the  direc¬ 
tion  of  the  cues  early  in  the  experiment.  It  was  obvious  from  this  short 
test  that  one  pilot  at  least  was  not  using  the  directional  nature  of  the 
cuss.  Special  training  with  tactile  cuing  only  (no  parallel  instrument) 
should  have  been  given  before  testing  was  started  to  make  certain  the 
pilots  were  familiar  with  the  cues. 


In  order  to  see  how  the  cues  would  affect  performance  when  they 
provided  glide-slope  deviations  instead  of  airspeed  deviations  one 
auxiliary,  four-test  series  was  run  using  pilot  TH  on  his  second  day  of 
ILS  landing  approaches.  Although  the  cuing  runs  produced  glide-slope 
error-power  scores  62  percent  (rough  air)  and  25  percent  (smooth  air) 
lower  than  the  control  runs,  these  improvements  were  not  judged  to  be 
significant. 


One  of  the  key  reasons  that  the  ILS  landing  is  a  difficult 
task  is  that  pilots  must  look  at  instruments  inside  the  plane  as  well 
as  the  runway  and  air  traffic  outside  the  plane  while  making  their 
approach.  This  inside  and  outside  viewing,  which  is  an  important  problem 
in  landing,  could  not  be  simulated  on  the  GAT-1  trainer.  As  a  result, 
pilots  spent  their  full  time  monitoring  their  instruments  and  did  a  good 
job  without  unreasonable  stress.  If  the  outside  part  of  landing  could 
have  been  simulated,  we  feel  that  the  tactile  cuing  3ystea  would  have 
had  a  more  natural  position  in  helping  the  pilot  determine  what  his 
instruments  were  telling  him  while  he  was  looking  out  the  window. 
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received  cuing  tried  both  directions  in  «  familiarization  session.  They 
both  chose  tho  vibrators  scanted  on  their  arms  so  that  turning  toward 
the  activated  vibrator  instead  of  away  from  it  nulled  out  the  error. 

This  "seeking”  instesd  of  "avoiding"  strategy  is  similar  to  other  in¬ 
strument  strategies  in  the  cockpit.  The  ILS  directional  display  and  the 
artificial  horizon  are  two  examples. 

•  b.  Subjects 

The  pilots  for  this  ex^brimsnt  were  picked  frca  about  15  volun¬ 
teer  private  pilots  who  wars  members  of  a  local  flying  club.  Four  pilots 
with  similar  flight  experience  and  having  less  than  200  hours  total  flight 
time  were  selected  from  this  group  and  paid  hourly  for  their  tine.  From 
the  four  pilots,  two  were  selected  at  random  for  the  cuing  program  and 
two  for  the  control  program;  The  four  pilots  selected  are  listed  by 
initials  end  hours  of  flight  time: 

Pilot  JIG — 90  hours  j 

}  Control  group 
Pilot  FS — 35  hours  I 

Pilot  BR — 100  hours | 

>  Cuing  group 
Pilot  2W—140  hours  J 

c.  Procedure 

TVo  auxiliary  tasks  were  used  to  load  the  pilots  while  they  were 
engaged  in  an  instrument  holding  task.  The  first  one — taking  and  repeating 
clearances — was  designed  to  offer  a  constant  load  to  the  pilots.  Approxi¬ 
mately  the  same  number  of  clearances  were  given  per  test  run  so  that 
changes  in  pilot  proficiency  could  be  measured  by  the  pilots’  heading  and 
altitude  error  scores.  The  second  task — working  simple  mathematics  prob¬ 
lems — was  designed  to  offer  an  increasing  load  to  the  pilots.  In  this 
way  their  ability  to  handle  extra  work  loads  could  be  measured  in  the 
number  of  problems  they  completed  per  test  run ,  A  third  tass  measured 
the  pilots’  ability  to  control  the  GAT-1  on  the  same  holding  task  without 
external  disturbances .  These  three  tasks  are  outlined  in  more  detail 
bole* : 


(1)  Free  Flight.  After  taking  off  and  flying  to  1G00  feet, 
t»-e  pilot  was  requested  to  hold  his  altitude  constant  at 
1U00  feet  and  his  heading  constant  at  270°  while  the 
GAT-1  was  under  maximum  turbulence  as  generated  by  the 
internal  rough -air  system.  When  he  arrived  on  altitude 
and  beading  the  pilot  signaled  the  experimenter,  who 
started  the  five -minute  computer  monitoring  program. 

At  the  end  of  the  program  the  computer  *>r J.ted  out  the 
altitude  and  heading  error-power  score". 


(2)  Clearances .  The  sane  holding  condition  as  in  tree  flight 
above  except  that  the  pilot  received  clearances  over  the 
GAT-1  intercom  system,  noted  them  down  in  his  own  short¬ 
hand,  and  repeated  them  back  to  the  experimenter  over  the 
intercom,  if  the  pilot  missed  any  part  of  the  clearance, 
the  whole  clearance  vae  repeated  to  him  again.  Typical 
clearances  used  in  this  test  are  given  in  Appendix  D. 

(3)  Mathematics.  The  same  holding  condition  as  in  Item  1 
above  except  that  the  pilot  received  simple  multiplica¬ 
tion  problems  verbally  over  the  GAT-1  intercom.  He  took 
the  problem  down  on  a  note  pad,  worked  it  out,  and  re¬ 
ported  the  answer  back  to  the  experimenter.  If  the 
answer  was  correct  a  new  problem  was  given;  if  incorrect 
he  was  asked  to  work  the  same  problem  again.  The  number 
of  problems  worked  successfully  was  recorded  for  later 
analysis.  Typical  math  problems  used  are  shown  in 
Appendix  D . 

Each  subject  was  tested  in  five  two-hour  sessions  arranged  at 
his  convenience.  The  first  session  was  a  familiarization  with  the  GAT-1 
trainer,  the  three  above  conditions  of  the  experiment,  and  for  pilots  in 
the  cuing  group,  operation  of  the  tactile  cuing  system.  The  next  four 
sessions  involved  two  tests  with  clearances,  two  with  the  math  problems, 
end  one  with  free  flight.  Pilots  in  the  cuing  group  received  tactile 
cuss  on  one  of  the  two  math-problem  tests  and  one  of  the  two  clearance- 
problem  tests  while  those  in  the  control  group  received  no  cuing  on  either 
pair  of  tests.  The  actual  experimental  design  used  in  this  experiment 
is  given  in  Appendix  D. 

2.  FREE -FLIGHT  RESULTS 

The  error-power  scores  from  each  test  were  converted  to  root  mean 
square  (RIB)  deviations  (see  Fig.  23).  This  RMS  deviation  (the  same  as 
the  standard  deviation  of  the  errors  sometimes  used)  is  given  for  all  four 
tost  subjects  in  the  experiment.  Figure  23  shows  that  all  the  subjects 
improved  in  both  altitude  and  heading  error  over  the  five  test  sessions. 
The  data  presented  in  all  four  graphs  was  given  an  analysis  of  variance 
to  determine  its  significant  aspects.  The  results  of  the  analysis  are  out 
lined  below: 

(1)  Changes  in  altitude  error  with  session  are  not  significant 

f?  (4,20)  =  3.13,  p  >  0.05],  while  similar  changes  in  heeding 
error  are  significant  [P  (4,10)  =  3. 86,  p  <  0.05]. 

(2)  There  is  no  significant  difference  between  cuing  and  control 
group  either  in  altitude  error  CP  (1,10)  =  1.74,  p  >  0.05] 
or  in  heading  error  [F  (1,10)  <  1]. 
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(3)  There  is  no  significant  interaction  between  the  two  groups 
and  sessions  for  either  heading  error  or  altitude  error, 
indicating  that  one  group  did  not  learn  faster  than  the  other. 

These  results  indicate  that  the  two  groups  were  very  well  Batched. 

In  addition,  they  show  that  in  the  absence  of  extra  work  loads  the  tactile 
cuing  did  not  quicken  learning  on  this  task  or  allow  subjects  to  reach 
better  performance  levels. 

3 .  CLEARANCE  RESULTS 

The  RHS  altitude  and  heading  errors  of  both  the  cuing  and  the  control 
groups  ware  computed  from  their  error-power  scores  and  plotted  in  Fig.  24. 
Learning  trends  in  the  cuing  group  appear  to  be  larger  and  final  error 
scores  smaller  than  those  of  the  control  group.  The  data  of  both  cuing 
and  control  groups  were  given  several  analyses  of  variance  to  compare 
learning  in  each  group  and  differences  between  the  two  groups.  The  re¬ 
sults  are  summarized  as  follows : 

(1)  Both  the  altitude-  and  heading^rror  scores  of  the  cuing  group 
decreased  with  practice  [F  (4,10)  =  6.75,  p  <  0.01  and 

F  (4,10)  =  4.07,  p<  0.05,  respectively],  but  there  were  no 
differences  between  sessions  with  and  without  cuing  in  the 
group . 

(2)  Neither  the  altitude-  nor  heading-error  scores  of  the  control 
group  showed  significant  improvement  with  practice. 

(3)  The  cuing-group  error  scores  were  significantly  less  than  those 

of  the  control  group  in  both  altitude  [F  (1,30)  =  52.6,  p<  0.001] 
and  heading  [F  (1,30)  =  22.5,  p<  0.001]. 

These  results  substantiate  that  in  this  holding  task  with  clearances, 
pilots  receiving  the  cuing  progress  more  quickly  than  those  in  the  control 
group. 

4.  MATH-PROBLEM  RESULTS 

The  RMS  altitude  and  heading  errors  for  both  groups  are  shv>wn  in  Fig. 
25.  Again  the  cuing  group  apparently  learned  sore  quickly  than  the  con¬ 
trol  group,  but  in  this  task  the  differences  do  not  appear  as  great  as  in 
the  clearance  task.  The  data  were  given  several  analyses  of  variance  to 
determine  whether  the  changes  and  differences  are  significant.  Only  data 
of  the  last  four  sessions  were  used  in  the  analysis  since  two  complete 
tests  were  not  made  in  Test  Session  1.  The  results  of  the  analyses  of 
variance  were  as  follows: 

(1)  Neither  altitude-  nor  heading-error  scores  of  either  group 
showed  any  significant  changes  with  practice. 
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(2)  In  the  cuing  group  there  were  no  significant  differences 
between  errors  on  cuing  and  noncuing  tests, 

(3)  The  cuing  group  had  significantly  less  error  than  the  control 
group  in  both  altitude  [F  (1,24)  =  124,  p  <  0.001]  and  heading 
OF  (1,24)  =  13.4,  p  <  0.001]. 

The  lack  of  significant  learning  by  the  cuing  group,  even  though  there  is 
an  apparently  strong  downward  curve  in  Fig.  25,  is  due  to  the  fact  that 
only  the  lsst  four  sessions  were  analyzed.  This  indicates  that  much  of 
the  improvement  occurs  over  the  first  few  test  sessions. 

Although  the  number  of  multiplication  problems  worked  by  the  pilots 
during  the  tests  was  originally  planned  as  a  measure  of  performance,  there 
was  very  little  change  in  the  number  of  problems  worked .  The  number  of 
problems  worked  on  the  different  test  sessions  by  either  group  was  not 
significant,  nor  was  the  number  worked  by  the  cuing  group  in  cuing  or 
noncuing  tests  (8.1  vs.  7.5  probleas/test),  nor  the  different  number 
worked  by  the  two  groups  (cuing  group,  7.8  problems/test,  and  control 
group,  8.6  problems/test) .  The  pilots  evidently  strove  to  better  their 
flying  performance  while  maintaining  their  work  loads  fairly  constant. 

5 .  DISCUSSION 

To  facilitate  comparison  of  the  three  tasks  used  in  this  experiment, 
the  data  of  Figs.  23,  24,  and  25  has  been  averaged  and  replotted  in  Fig. 
26.  The  data  for  both  pilots  and  both  tests  within  each  group  has  been 
averaged  together.  In  addition,  the  free  flight  data  for  both  groups  has 
been  averaged  together,  since  there  were  no  significant  differences  be¬ 
tween  the  groups.  Comparing  groups  in  Fig.  26  shows  the  difference  in 
learning  behavior,  especially  on  heading  error,  the  variable  that  drove 
the  cuing  system.  The  group  with  cuing  significantly  reduced  their  error 
scores  with  practice,  while  the  control  group  maintained  their  initial 
error  scores  at  a  more  or  Jess  constant  level  axsd  did  not  significantly 
improve . 

Comparing  the  three  tasks  in  Fig.  26  shows  the  increasing  difficulty 
of  the  free  flight,  seth-problem,  and  clearance  tasks.  The  more  diffi¬ 
cult  tasks  have  the  higher  error  scores  and  more  potential  room  for  im¬ 
provement.  While  there  was  no  difference  between  the  two  groups  on  the 
free  flight  tests,  the  difference  grew  with  task  difficulty.  When  asked 
after  the  test  seriea  was  over,  three  of  the  four  pilots  reported  that  the 
clearance  task  was  the  most  difficult. 

An  important  question  answered  by  this  experiment  is  whether  pilots 
with  cuing  beccae  dependent  of  it  for  further  good  performance.  With 
both  the  clearance  and  mathematics  tasks  there  were  no  statistically 
significant  differences  between  pilots  of  the  cuing  group  when  using  or 
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SECTION  VII 


DESIGN  AND  EVALUATION  0?  A  TACTILE  CUING  SYSTEM 


As  a  result  of  the  careful  survey  and  experimental  work  outlined  in 
the  previous  sections,  we  wish  to  express  concern  that  the  level  of  under¬ 
standing  of  tactile  systems  and  thair  application  has  not  yet  advanced  to 
the  point  where  a  design  for  a  cuing  system  can  be  proposed  without  any 
qualifications.  Additions!  research  should  first  be  undertaken  to  determine 

(1)  The  complex  relationships  between  visual  tasks  and  an  auxiliary 
tactile  task  in  the  aircraft  control  situation 

(2)  How  display  parameters  for  a  given  tactile  display  should  be 
selected 

(3)  The  performance  difference  between  tactile  displays  mounted 
on  the  controlling  body  somber  and  displays  located  elsewhere 
on  the  body 

(4)  The  performance  difference  between  displays  that  can  be  volun¬ 
tarily  sensed  and  "worn”  displays 

(5)  How  to  effectively  use  sore  dimens ione  in  tactile  displays. 

If,  however,  it  is  imperative  that  a  cuing  system  be  built  and  tasted 
immediately  to  take  advantage  of  the  learning  acceleration  reported  in 
Sec.  VI,  we  recommend  a  two-stage  experimental  design.  The  first  stage 
should  essentially  replicate  the  results  of  Sec.  VI.  5'erformance  dif¬ 
ferences  between  a  much  larger  cuing  group  and  *  much  larger  control  group 
not  using  the  one-d imsnsional  cuing  system  should  be  made.  The  details 
of  this  experiment  are  outlined  in  Sec.  VII-1,  below,  which  describes 
Design  I.  Only  if  the  learning  criterion  explained  in  Design  I  is  met 
(basically  a  significant  increase  in  learning  rate  with  cuing  on  a  loaded 
task)  should  the  more  elaborate  cuing  system  of  Design  II  be  carried  out. 

If  Design  II  is  entered  and  training  procoedn  successfully,  then  two 
control -vs. -cuing  tests  are  recommended  to  measure  the  generality  of  the 
speeded  learning  with  cuing .  If,  in  addition,  both  of  these  tests  are 
successful,  as  explained  in  Sec.  VII-2  (Design  II),  then  further  imple¬ 
mentation  of  the  same  system  on  a  flying  trainer  ic  recommended . 

It  should  be  kept  in  mind,  however,  that  these  two  designs  represent 
extrapolations  from  state-of-the-art  cuing  devices  and  their  understanding . 
Future  work,  especially  in  the  five  areas  outlined  at  the  beginning  of  this 
section,  may  allow  tactile  displays  to  achieve  wider  application  or  to 
bring  about  faster  performance  changes.  Considering  the  present  early 
stages  of  understanding  in  the  tactile-research  field  and  its  high  rate  of 
development,  it  is  not  advisable  to  expend  a  large  amount  of  funds  in 


testing  and  Implementing  the  present  designs  without  sone  continued  and 
parallel  basic  research  related  to  pilot  training. 

1.  TACTILE  CUING  SYSTEM — DESIGN  I 

This  design  describes  a  one-dimensional  cuing  system  permanently 
connected  to  one  flight  variable  (heading)  to  be  used  in  a  ground-based 
flight  trainer  for  substantiating  the  results  of  Sec .  VI  of  this  report 
using  matched  groups  of  Air  Force  pilots.  The  experiment  is  basically 
the  same  as  that  reported  in  Sec.  IV,  except  that  a  much  larger  number 
of  pilots  is  tested  and  only  the  most  important  data  is  obtained  «tnd 
.analyzed.  The  outcome  of  this  experiment  determines  whether  work  should 
be  continued  on  Design  II  or  dropped .  The  experimental  design  for  testing 
this  cuing  system  closely  follows  that  of  Sec.  VI,  and  is  indicated 
schematically  in  Fig.  27  and  outlined  below. 


3EGINNING  INTERMEDIATE  ADVANCED 
PILOTS 


Figure  27  Experimental  Design  for  Testing  the  Effectiveness 
of  a  Cuing  Display 
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(1)  Design — A  two-dimensional  bolding  task  in  a  flight  simulator 
should  be  used.  Altitude  and  beading  are  highly  recommended 
as  the  two  dimensions,  but  are  not  necessarily  the  only  ones 
that  can  be  usod.  Both  dimensions  should  include  an  additive 
random  noise  which  the  subjects  try  to  overcome  while  taking 
the  repeating  clearances  over  an  intercom  system.  Section 
IV-l-c  contains  further  information  on  experimental  procedure. 

(2)  Tactile  Vibrators — Bagged  vibrators  capable  of  producing  a 
strong  feeling  of  vibration  are  required.  One  hundred  or  two 
hundred  microns  peak-to-peak  vibration  from  100  to  400  Hz  is 
adequate.  An  inertial -type  vibrator  instead  of  the  speaker- 
type  vibrator  described  in  Sec.  IV-l-a-(l)  is  reccamended  for 
ruggedness.  An  easily  adjustable  elastic  strap  should  be  pro¬ 
vided  for  quick  attachment,  adjustment,  and  change  of  body 
area . 

(3)  Cues --Cues  should  be  given  with  the  two  threshold  vibrators 
(see  Sec.  IV-1)  ontbe  slowly  varying  variable  (heading)  such 
that  when  less  than  five  degrees  error  is  present  no  vibrator 
is  activated,  when  sore  than  five  degrees  right  error  is 
present  the  ricbt  arm  vibrator  is  activated,  and  when  more 
than  five  degrees  left  error  is  present  the  left-arm  vibrator 
is  activated.  This  choice  of  location  and  sign  convention  is 
discussed  in  Sec.  VI-1 -a. 

(4)  Subjects—At  least  five  pilots  should  be  selected  for  each  ex¬ 
perimental  condition.  Thus,  there  would  be  five  beginners, 
five  intermediate,  and  five  advanced  pilots  in  each  group,  or 
thirty  pilots  in  all,  each  to  be  given  ten  sessions  on  the 
same  task.  Choice  of  pilots  should  be  made  as  discussed  in 
Sec.  VI-1-b. 

(5)  Scoring — The  BUS  error  cf  the  heading-coordinate  variations 
from  the  required  position  should  be  obtained  by  taking  the 
square  root  of  the  heading  error  power. 

(6)  Analysis — A  mixed  design  analysis  of  variance  of  size 

2  x  3  x  10  x  5  (groups  by  pilot  experience  by  sessions  by 
pilots)  should  be  made  cn  the  above  heading-error  scores. 

The  crucial  test  for  success  is  the  se3s ion-by-group  inter¬ 
action.  If  this  interaction  is  significant  (5  percent  test) 
and  the  cuing  group  learned  faster  than  the  control  group, 
then  proceed  to  Design  II.  If,  in  addition,  the  session-by-- 
group-by-pilot  experience  interaction  is  significant  (5  per¬ 
cent  test),  sorting  the  cuing-vs .-session  results  by  pilot 
experience  will  show  which  experience  groups  most  efficiently 
utilize  cues.  In  this  case  Design  II  should  be  continued 
only  with  this  best  group. 


77 


group  oz  plxots  have  learned  to  us©  tfca  system.  If  those  tests,  involving 
ILS  lauding  and  cross-country  navigation  are  successful,  measured  with  the 
criteria  of  Design  I.  then  further  implemeotation  of  the  system  os  on o 
trainer  airplane  is  rocowaeaded ;  if  the  tacts  urs  sot  successful,  the 
.System  should  be  dropped,  the  experiments!  design  for  testing  thie  ex¬ 
tended  cuing  system  closely  parallels  that  of  Design  I,  and  is  described 
belaw: 

(IV  Tactile  Vibrators — Sees  an  recossee nded  for  Design  I . 

(2)  Source  Switch  Box — For  reference-signal  selection  the  cuing 
system  should  contain  c  multiple -position  switch  operable  by 
either  the  instructor  or  the  student  pilot,  the  selector 
switch  should  be  able  to  connect  the  two  vibrators  to  any  of 
the  following  reference  signals  in  the  trainer: 

ILS  Glide  Slope,  +5°  cues 
ILS  left  Tight,  ±5°  cues 
ADF  left-right,  ±5°  cues 

Air  speed — adjustable  speed  center,  i5  *ph  cues 
Altitude — adjustable  altitude  center,  ±50  feet  cues 
Heading — adjustable  heading  center,  ±5°  cues. 

Hate  of  climb — adjustable  rate  center,  ±50  feet/min  cues. 

Selecting  a  switch  position  aid  turning  one  knob  to  the 
reference  position  is  all  the  vork  thst  should  be  required . 

The  internal  cuing  limits  should  be  internally  wired  so  thst 
within  the  dead  zone  there  is  no  vibration  and  outside  the 
zone  only  the  one  appropriate  vibrator  is  full  on. 

(3)  Ira in Ing  Procedure — Training  along  the  following  lines  is 
recoismended  before  U3e  of  ih6  cuing  system.  First  the  student 
should  be  familiarised  with  tbs  general  idea  of  the  caieg 
system  by  both  explanation  3Dd  demonstration  of  one-dimensional 
holding.  Secondly,  he  should  bo  tested  on  each  holding  coor¬ 
dinate  by  temporarily  covering  the  basic  visual  instrument  and 
watching  to  see  that  he  holds  that  coordinate  within  the  cuing 
limits.  Lastly,  several  complete  practice  runs  such  as  an  ILS 
landing  using  airspeed  or  left-right  cuing  or  an  altitude¬ 
holding  run  using  the  altitude  cues  should  he  carried  out. 

<4)  Implementation  Schedule— -The  cuing  syste?  should  first  be  imple¬ 
mented  in  a  fired -base  trainer  and  given  further  testing  by 
pilots  trained  with  the  cuing  system  as  described  above.  If 


enough  pilots  freoly  and  voluntarily  us®  the  syrtee,.  then  two 
additional,  controlled  experiments  should  be  carried  out  to 
further  compare  a  control  group  and  cuing  group.  Both  of  these 
experiments  use  the  forest  of  Design  I;  only  the  task  is  changed 
The  first  experiment  should  be  5n  TLS  landing  approach  with  air¬ 
speed  cuing  ranairifig  the  pilot  to  contact  the  control  tower 
snd  to  work  op.  ETA  problem  as  a  side  task.  The  second  experi¬ 
ment  should  ho  cross-country  navigation  using  the  ADF  with  left- 
right  cues,  requiring  the  pilot  to  tork  a  navigation-type  problem 
of  similar  complexity  on  each  run  for  a  side  lead.  The  experi¬ 
mental  design  and  evaluation  should  be  carried  out  using  st  least 
ZQ  pilots  (equal  nusbsrs  in  the  cuing  and  control  groups),  as  in 
Design  I,  but  lumping  pilots  of  mined  experience  together.  If 
both  of  these  results  are  succesafnl  as  specified  in  the  first 
test  of  Design  I,  further  implementation  of  the  fioao  system  in 
a  trainer-type  airplane  for  use  in  flight  situations  is  reccc- 
sended.  If  a  trainer  is  used  in  this  way,  particular  emphasis 
1‘hould  bi  placed  os  developing  £LS  Is&ding  approaches  ®ith  thft 
system . 
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APPENDIX  B 

DESCRIPTIONS  OF  THE  GAT-1  DISPIAY  EVALUATION  EXPERIMENTS 


Hold  constant  altitude  and  heading 
Program  GATXO  (GARTKO  for  air  jets) 


Run  Time:  5-1/4  minutes 
Monitor:  altitude  and  heading 
Display  Gain:  0.5  volt  (133  feet)  full  scale 
Tactile  Signal:  CAH-A  designation  for  altitude  cue 
(primary  signal) 

CAH-H  designation  for  heading  cue 
(secondary  signal) 

Sequence  of  Events 

(1)  Pilot  takes  off  and  flies  to  1000  feet;  trims  plane  for  level 
flight  at  110  mph  (TACH  =  24G0)  at  heading  of  270°.  Maintains 
heading  and  altitude  constant  throughout  this  run. 

(2)  Experimenter  starts  LINC-8  program,  defines  time  as  time  zero. 

(3)  After  30  seconds  from  time  zero,  pilot  reduces  power  (to 

TACH  =  1700)  and  continues  without  changing  altitude  or  beading 

(4)  At  2  minutes  from  time  zero,  pilot  increases  power  (TACH  =  2400 

(5)  At  3-1/2  minutes  from  time  zero,  pilot  decreases  power 
(TACH  =  1700) . 

(6)  At  5  minutes  from  time  zero,  pilot  increases  power  (TACH  =  2400 


EXPERIMENT  AT 


Altitude  tracking 

Program  GATK1  (GARTK1  for  air  jets) 


Run  Time:  5-1/4  minutes 
Monitor:  Altitude  and  heading 
Command  Signal:  350  feet  peak  altitude  change 
Display  Gain:  0.25  volt  (66  feet)  full  scale 
Tactile  Signal:  AT-A  designation  for  altitude  cuing 
AT-B  designation  for  heading  cuing 


i 


Sequence  ofF.r  ents 


(1)  Pilot  takes  off  and  flies  to  1000  feet  on  heading  270°  (due 
west).  Trims  plane  for  level  flight  at  100  mph. 

(2)  Experimenter  starts  LINC-8  program. 

(3)  Pilot  continues  flying,  holding  altitude  constant  at  1000  feet 
and  heading  at  270°.  Pilot  uses  throttle  control  to  avoid 
stall  and  overspeed  conditions  when  necessary. 


EXPERIMENT  CS 

Holding  constant  airspeed  while  making  instrument  landing  with  ILS 
system 

Program  GATKO  (GARTKO  for  air  jets) 

Run  Time:  5-1/4  minutes 

Monitor:  Airspeed  and  glide  slope 

Display  Gain:  0.25  volt  (5  mph)  full  scale 

Tactile  Signal:  CS-S  designation  for  airspeed  cue  (primary  cue) 
CS-GS  designation  for  glide-slope  cue 
(secondary  cue) 


Sequence  of  Events 


(1)  Pilot  takes  off  and  flies  to  2000  feet  on  heading  288°.  Trim 
plane  for  level  flight  at  85  mph. 

(2)  Experimenter  positions  airplane  near  center  of  beam  10  miles 
from  airport.  Pilot  flies  to  the  left-right  beam  first;  then, 
when  he  crosses  the  glide-slope  beam  the  first  time  the  experi¬ 
menter  starts  the  LINC-8  program. 

(3)  Pilot  flies  down  beam  while  maintaining  airspeed  at  85  mph  and 
keeping  the  ILS  indicator  zeroed. 


APPENDIX  C 

PILOT  RANKING  AND  COMMENTS  ON  THE  FIVE  TACTILE  DISPLAYS 


Device 

[  Rank  Ordering 

1  1  =  Best 
|  5  =  Worst 

Comments 

(Adequacy,  use  during  training, 
ease  of  interpreting,  etc.) 

COMMENTS  ON 

TACTILE  CUING  DEVICES— PILOT  BD 

Air  Jets 

2 

Cuing  not  strong  enough.  Difficult  to  distinguish 
between  senses  of  cue. 

Linear  Vibrator 

— 

Pilot  did  not  use  display. 

Threshold  Vibrator 

3 

Good  indicator.  Threshold  devices  most  useful  (pro¬ 
vided  "off”  range  wide  enough) . 

Thumb  Button 

4 

Difficult  to  detect.  Had  to  move  thumb  back  and 
forth . 

Pal*  Button 

3 

Difficult  to  dotect.  Good  cue  for  altitude  if  more 
detectable. 

’  1 

Note:  All  cues  involving  the  left-hand  were  difficult  to  detect  due  to  tight  grip  on 
wheel. 

Threshold  Vibrator 


Thumb  Button 


Palm  Button 


Air  Jets 


Linear  Vibrator 


Threshold  Vibrator 


Thumb  Button 


Pal*  Button 


ON  TACTILE  CUING  DEVICES— PILOT  CR 


Good  for  alerting  subject  to  some  conditions.  The 
direction  of  the  error  was  sometimes  difficult  to 
interpret . 

Adequate  for  most  uses.  Particularly  good  for  dis¬ 
playing  errors  that  vary  widely.  Not  useful  for 
errors  the  subject  is  already  holding  within  small 
tolerances . 

Very  good  for  alerting  subject.  Particularly  good 
for  signals  that  change  very  slowly  and  thus  should 
not  require  much  visual  monitoring.  Direction  indi¬ 
cations  very  good . 

Needed  more  travel  to  be  adequate .  Had  to  be 
actively  monitored  by  subject.  Not  very  alerting. 

Had  to  be  actively  monitored  by  subject.  Failed  to 
alert  subject  to  extreme  conditions. 


COMMENTS  ON  TACTILE  CUING  DEVICES— PILOT  TH 


Little  or  no  resolution  between  "up"  and  "down"  sig¬ 
nals.  No  indication  that  either  intensity  or  posi¬ 
tion  changed  with  increasing  error  (gain  too  low?). 

Sensitivity  lost  after  initial  error  signal  has  been 
on  for  more  than  a  few  seconds.  Some  difficulty 
sensing  polarity;  it  was  not  iEsaediately  apparent 
which  buzzer  was  on. 

Same  problems  as  the  linear  vibrator;  no  information 
in  the  dead  baDd  suggests  increased  error  rates. 

This  display  had  all  the  prerequisites  of  a  useful 
aid:  gain  high  enough,  or  adjustable,  very  small 
dead  band,  ease  of  thumb  ootion  allows  initial  sensi¬ 
tivity  level  to  be  maintained,  and  very  definite 
polarity  sensing. 

Same  as  for  the  thumb  button,  except  for  loss  in 
sensitivity  due  to  lack  of  motion  8ase;  also,  the 
position  of  the  display  made  adequate  contact  un¬ 
comfortable  and  thus  detracted  frosa  its  general  per¬ 
formance  level. 
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DESIGN  OF  A  PRELIMINARY  EXPERIMENT  TO  TEST  A  TACTILE  CUING  SYSTEM 


APPENDIX  D 


DESIGN  OF  A  PRELIMINARY  EXPERIMENT  TO  TEST  A  TACTILE  CUING  SYSTEM 


The  experimental  design  used  in  Sec.  VI  is  given  in  Table  D-l .  Ba< 
test  ran  is  five  minutes  long.  Saaple  clearances  and  mathematics  prob- 
less  are  given  in  Tables  D-2  end  D-3.  The  sathematics  problems  require 
the  Multiplication  of  a  two-digit  ran do*  number.  A,  by  a  three-digit 
random  number,  3,  to  get  the  an  seer  shown  in  coluan  A  x  B  of  Table  D-3. 


Table  D-l 

TEST  SCHEDULE  FOR  CUISG-SYSTEM  EXPERIMENT 


SUBJECT 


FLIGHT  EXPERIENCE  (HR) 


Run  1 

Run  3 

Run  4 

Run  5 

Session  1 

Familiarization  with 
GAT-1  and  Experiment 

Level 

— 

Clearance 

Math 

Clearance 

Citing 

Session  2 

Test 

Clearance 

Cues 

Clearance 

Math 

Cues 

Hath 

Level 

Session  3 

Clearance 

Clearance 

Cues 

Math 

Math 

Cues 

Level 

Test 

Sossion  4 

Test 

-  _  .  -  — 

Clearance 

Cues 

Clearance 

Math 

Math 

Cues 

Level 

Session  5 

Test 

»  - - - 

Clearance 

Clearance 

Cues 

Math 

Cues 

Math 

Level 

Rough  Air  Always  Full  On.  Fog  covers  on  windows.  : 

Level  =  Flight  at  1000 -ft  altitude,  270°  heading  j 

;  Clearance  =  Same  as  level;  pilot  takes  and  repeats  approximately  three  3 

[  clearances  ] 

[  Math  =  Sane  as  level;  pilot  to  work  aath  problems  continuously  ] 

[  Cues  =  Heading  cuing  on  ars  vibrators  1 
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Table  D-2 


SAMPLE  CLEARANCES 

(1)  LINS  1234  CLEARED  FOR  7AEE0FF,  TURN  LEFT  AFTER  DEPARTURE  TO  HEADING 
240,  CLIMB  OH  COURSE  TO  FIVE  THOUSAND,  REPOS?  FIVE  TSNJSAIB  TO 
DEPARTURE  CONTROL,  FREQUENCY  WILL  EE  121.1. 

(2)  AIR  TRAFFIC  CONTROL  CLEARS  LIKE  1234  TO  THE  WASHINGTON  AIRPORT  VIA 
VICTOR  14  SOUTH,  CROSS  SHAIKSHY  INTERSECTION  FIVE  THOUSAND,  MAINTAIN 
SEVER  THOUSAND  TO  THE  SUNT?  INTERSECTION,  DESCEND  TO  THREE  THOUSAND 
ON  HEADING  19?  AND  CONTACT  TOWER  OH  123.2. 

(3)  ATC  CLEARS  LIKE  1234  TO  THE  SXYLINE  AIRPORT  VIA  THE  CROSSVIIiS  055 
RADIAL  VICTOR  IS,  MAINTAIN  FIVE  THOUSAND,  CLEARANCE  VOID  IF  NOT  OFF 
BY  1330. 


Tabid  D-3 

TWENTY  SAMPLE  MULTIPLICATION  PR0KL3IS 


Probles  Nusbcr 

A 

B 

A  X  B 

100 

25 

360 

90G0 

101 

S4 

745 

70030 

102 

42 

756 

31752 

103 

81 

705 

57105 

104 

62 

902 

55924 

105 

16 

759 

12144 

106 

64 

587 

37568 

107 

57 

697 

39725 

108 

26 

500 

13000 

109 

93 

308 

28644 

110 

18 

430 

7740 

111 

13 

280 

3640 

112 

18 

166 

2988 

113 

65 

lUVM 

26130 

114 

95 

398 

37810 

115 

50 

464 

23200 

116 

49 

913 

22737 

117 

35 

255 

8925 

118 

38 

602 

22876 

129 

89 

464 

41296 
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SELECTED  BIBLIOGRAPHY  ON  BIOSTIMULATION  AND  BIOELECTRIC  CONTROL 


A  preliminary  review  of  the  literature  and  current  research  waa 
carried  out  to  assess  the  feasibility  and  appropriateness  of  biostimu- 
lation  and  bioelectric  control  for  pilot  training  and  aircraft  control. 
For  this  purpose  the  area  under  study  was  defined  as  electrical  stimula¬ 
tion  to  produce  either  a  muscular  response  or  a  sensation. 


The  papers,  reports,  and  conferences  reviewed  are  listed  below  in 
five  categories. 

1.  BASIC  PHYSIOLOGY  OF  CONTROL  OF  MOVEMENT  (Reference  books  and  current 
research  on  the  neurological  mechanisms  that  control  movement  in 
humans) 

Coers.  c.,  and  A.  L.  Woolf,  The  Innervation  of  Muscle  (Charles 
C.  Thomas ,  Springfield/ Illinois.  1959). 

Denny-Brown,  D.,  The  Cerebral  Control  of  Movement  (Charles  C. 
Thomas ,  Springfield,  Illinois,  1959). 

Hunt,  C.  C . ,  and  S.  W.  Xuffier,  "Kotor  Innervation  of  Skeletal 
Muscle:  Multiple  Innervation  of  Individual  Muscle  Fibres 
and  Motor  Unit  Function,"  J.  Physiol.,  Vol.  126.  dp.  293- 
203  (1954).  - 

lannone,  A.  H.,  and  L.  Cohen,  "Control  of  Movement  in  Hemiplegia," 
Stanford  University  Medical  School,  Palo  Alto,  California, 
Vocational  Rehabilitation  Administration  Project  (1966). 

Leifer,  L.  J.,  "Characterization  of  Single  Xu3cle  Fiber 

Discharge  During  Voluntary  Isometric  Contraction  of  the 
Biceps  Brachii  Muscle  in  Kan,"  PhJD.  Thesis,  Stanford 
University,  Neurological  Sciences  (June  1969) . 

KcRuer,  D . ,  et  al.,  "Human  Pilot  Dynamics  in  Compensatory 

Systems;  Theory,  Models,  and  Experiments  with  Controlled 
Element  and  Forcing  Function  Variations,"  Technical 
Report  No.  AFFDL-TR -65-15,  bright— Pa tterson  Air  Force 
Base,  Ohio  (1965) . 

L.-Ruer,  D.  T.,  R.  E.  Xagdaleno,  and  G.  P.  Moore,  "A  Neuromuscular 
Actuation  System  Model,"  IEEE  Trans,  on  Kan-Machine 
Systems,  Vol.  MKS-S,  No.  3,  pp.  61-71  (September  I960). 


Zajac,  F.  E.,  "The  Mathematical  Formulation  of  the  Kinematic 
Properties  cf  Muscle  Derived  from  an  Experimental 
Investigation,"  PhJD.  Dissertation,  Stanford  University, 
Neurological  Sciences  (August  1968). 

CONTROL  BY  BRAIN  STIMULATION 

Delgado,  J.  M.,  "Sequential  Behavior  Induced  Repeatedly  by 

Stimulation  of  the  Red  Nucleus  in  Free  Monkeys"  Science, 

Vol .  148,  pp.  1361-1363  (1965). 

Pimneo,  L.  R.,  "Multiple  Electrode  Stimulation  and  Recording," 

Computers  and  Psychobiology  Workshop,  U.S.  Naval  Postgraduate 
School,  Monterey,  California,  sponsored  by  Office  of  Naval 
Research,  Washington,  D.C.  and  SRI  (1966). 

Pinneo,  L.  R.,  "Control  of  Purposive  Behavior  by  Programmed 
Stimulation  of  the  Brain,"  The  Physiologist,  Vol.  9, 
p.  2S7  (1966). 

Pinneo,  L.  R.,  "Programmed  Control  of  Purposive  Movement," 

Final  Report,  Contract  Nonr-475(ll) ,  June  1965-September 
1967,  Physiological  Psychology  Branch,  Office  of  Naval 
Research  (1967) . 

Pinneo,  L.  R.,  "Electrical  Control  of  Behavior  by  Programmed 
Stimulation  of  the  Brain,"  Nature,  Vol.  211,  No.  5050, 
pp.  705-708  (1966). 

EXTERNAL  CONTROL  OF  HUMAN  EXTREMITIES 

Alter,  R.,  "Bioelectric  Control  of  Prosthesis,”  MI7-RLE 

Technical  Report  446,  Contract  DA-36-039-AMC-03200(E) 

(1  December  1966) . 

"Some  Topics  on  Myo-Electric  Control  of  Orthotic/Prosthetic 
Systems,"  L.  Vodovnik,  Ed.,  Report  No.  EDC  4-67-17, 

Case  Western  Reserve  University,  Cleveland,  Ohio  (1967) . 

Glenn,  W.  W.,  A.  Kauro,  and  A.  S.  Chao,  "Remote  Stimulation  by 
Radio-Frequency  Transmission,"  Public  Health  Service 
Project  No.  HE  04651-09,  Yale  University  School  of  Medicine, 
333  Cedar  Street,  New  Haven,  Connecticut  (1968) . 

•  Quast,  J.  E.,  and  M.  S.  Seeger,  "Studies  in  Neuromuscular 
Facilitation,"  VA  Project  No.  73-67,  V.  A.  Hospital, 
Minneapolis,  Minnesota  (1967). 


Steinberger,  V.  W.,  and  E.  M.  Smith,  "Stimulus  Programming 
for  York  is  D enervated  Muscle,"  Public  Health  Service 
Project  No.  AC1/NB  07081-02,  University  of  Michigan, 

Ann  Arbor,  Michigan  (1968) . 

Waring,  ¥.,  "investigation  of  Myoelectric  Control  of  Functional 
Braces,"  Final  Report,  Research  Grant  Ho.  RD-1751-M, 

Dept.  Health,  Education,  and  Wolf  are.  Rancho  Los  Amigos 
Hospital,  Downey,  California  (19S8) . 

External  Control  of  Human  Extremities.  The  Proceedings  of  the 
International  Symposium,  Dubrovnik,  29  August-2  September 
1966,  Yugoslav  Committee  for  Electronics  and  Automation, 
Belgrade  (1967). 

4.  TRAINING  EFFECTS 

Carrow,  R.  E.,  et  al.,  "Effects  of  Voluntary  and  Electrically 
Forced  Training,"  Public  Health  Service  Project  No.  5  RG1 
(at  12261-03,  Michigan  State  University,  East  Lansing, 
Michigan  (1987) . 

5  .  CONTROL  OF  SENSATION 

Brindley,  G.  S.,  and  W.  S.  Levin,  "The  Sensations  Produced  by 
Electrical  Stimulation  of  the  Visual  Cortex,"  J.  Physiol., 
Vol .  196,  No.  2,  pp.  479-494  (May  1968). 

Gibson,  R.  H.,  "Electrical  Stimulation  of  Pain  and  Touch,”  in 
The  Skin  Senses,  D.  R.  Kenshalo,  Ed.  (Charles  C.  Thomas, 
Springfield,  Illinois,  1966) . 

Gibson,  R.  H.,  "Electrical  Stimulation  of  the  Skin — A  Selected 
Bibliography,"  issued  by  IRIS,  American  Foundation  for 
the  Blind,  Inc.,  New  York,  New  York  (July  1967). 

As  a  result  of  this  preliminary  review,  the  following  tentative  con¬ 
clusions  were  reached: 

(1)  Electrical  stimulation  with  akin  electrodes  near  the  periphery 
for  control  of  novenent  appears  to  be  a  difficult  task  requiring 
further  development  before  immediate  application  in  the  training 
situation  should  be  attempted . 

When  one  considers  that  at  the  spinal  level,  each  muscle  has 
associated  with  it  a  pool  of  thousands  of  alpha  motor  neurons, 
at  least  two  systems  of  sense-organ-controlling  motor  cells, 
the  static  and  dynamic  gasoa  neurons,  three  classes  of  receptors 


involving  several  hundred  channels  of  input  information  to  the 
cord,  and  associated  clusters  of  interneurons  that  serve  to 
integrate,  distribute,  and  modify  the  activity  within  the  cord 
and  the  control  loops  by  which  coaacunication  with  the  muscle 
is  effected,  it  is  easy  to  understand  why  bypassing  this 
systea  by  sisply  applying  a  control  signal  directly  to  the 
auscle  will  not  produce  precise  controlled  movements.  More¬ 
over,  cost  Movements  involve  sany  Muscles,  not  just  one. 

(2)  If  this  peripheral  nervous  systsa  is  not  bypassed  and  the 
input  signal  is  applied  directly  to  the  appropriate  regions 
of  the  brain,  then  s»oother,  more  complex  movements  can  be 
obtained.  However,  this  method  is  impractical  for  applica¬ 
tion  in  the  training  situation. 

(3)  Recent  results  from  basic  studies  in  muscle  physiology  (e.g., 
Zajac,  1S6S,  and  Leif er,  1969)  suggest  new  approaches  for 
acquiring  control  signals  from  muscle  in  man  and  for  injecting 
control  signals  into  auscle.  For  example,  Leifer’s  experiments 
show  that,  at  least  under  isometric  conditions,  muscle  tension 
is  controlled  by  muscle-fiber  recruitment  rather  than  frequency 
of  firing  of  the  motor  neurons.  This  result  has  implications 
in  the  design  and  placement  of  electrodes  and  in  the  fora  of 
signal  processing  to  be  used.  However,  these  basic  studies 
need  to  be  extended  to  cover  a  wider  range  of  conditions  (e.g., 
other  than  isoaetric)  before  immediate  application  can  be  made . 

(4)  Electrical  stimulation  for  cuing,  either  by  producing  sensation 
or  by  causing  a  muscle  twitch,  is  feasible.  But  the  relative 
advantages  and  disadvantages  of  these  techniques  must  be 
weighed  against  other  alternatives,  such  as  tactile  cuing. 
Further  investigation  should  help  verify  and  clarify  these 
points  so  that  reasonable  decisions  can  be  made.  Meanwhile, 

it  is  our  opinion  that  at  this  point  in  time,  tactile  cuing 
offers  greater  promise  than  electrical  stimulation. 

(5)  Brindley’s  results  with  cortical  stimulation  are  very  surprising 
and  further  work  in  visual  prosthesis  should  be  watched  for 
possible  application.  However,  in  view  of  the  potential  dangers 
involved,  it  is  likely  to  be  quite  some  time  before  this  re¬ 
search  has  reached  the  point  that  application  will  be  warranted, 
if  it  ever  does . 
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IT  *«TR»CT 

'*  Several  vibrator,  air  jot,  and  moving -but ton  tactile  stimulator-units  were 
evaluated  as  cuing  aids  for  pilot  training  in  a  manual  tracking  task.  The  best  unit3, 
as  determined  by  mininun  nean  square  error  and  best  operator  describing  function  were 
built  into  a  flight  simulator.  These  units  were  further  evaluated  for  their  ability 
to  help  pilots  control  the  trainer  in  some  flight-simulation  tracking  tasks  such  as 
altitude  holding  and  ILS  landing.  A  one-dirsensional  tactile  cuing  system  wss  de¬ 
signed  using  information  obtained  from  these  experiments .  The  cuing  system,  which 
consisted  of  two  vibrators  attached  to  the  ams  indicating  heading  error  in  excess 
of  five  degrees,  was  tested  in  a  controlled  experiment  with  four  pilots  having  less 
than  200  hours  of  flight  ti rse.j  Tbe-two-p-i-leijr  using  the  cuing  system  learned  g ig»i  £-i« 
cantly  faster  than  the  two  pilots  not  using  the  system.  This  increased  learning  rate, 
however,  was  only  seen  when  the  pilots  wore  er  gaged  in  side  tasks  such  as  problem 
solving  and  the  taking  of  clearances.  Plans  for  a  more  complete  test  of  this  cuing 
I  system  and  for  possible  extensions  of  the  cuing  systen  to  other  aircraft  variables 
j  are  suggested.  A  selected  review  of  the  literature  and  current  research  was  carried 
out  to  assess  the  feasibility  and  appropriateness  of  biostisulation  and  bioelectric 
control  for  oiloi  training  and  aircraft  control.  - 
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